-- Logs begin at Wed 2022-08-31 00:28:26 UTC, end at Wed 2022-08-31 01:25:38 UTC. -- Aug 31 00:53:53.789102 dv-cinder-855288-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 00:53:53.802494 dv-cinder-855288-2-smb devstack@keystone.service[81469]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:53:53 2022] *** Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: nodename: dv-cinder-855288-2-smb Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: machine: x86_64 Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: clock source: unix Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: pcre jit disabled Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: detected number of CPU cores: 4 Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: current working directory: / Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:53:53.804474 dv-cinder-855288-2-smb devstack@keystone.service[81469]: your processes number limit is 47680 Aug 31 00:53:53.805243 dv-cinder-855288-2-smb devstack@keystone.service[81469]: your memory page size is 4096 bytes Aug 31 00:53:53.805243 dv-cinder-855288-2-smb devstack@keystone.service[81469]: detected max file descriptor number: 2048 Aug 31 00:53:53.805243 dv-cinder-855288-2-smb devstack@keystone.service[81469]: lock engine: pthread robust mutexes Aug 31 00:53:53.805243 dv-cinder-855288-2-smb devstack@keystone.service[81469]: thunder lock: enabled Aug 31 00:53:53.805243 dv-cinder-855288-2-smb devstack@keystone.service[81469]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 00:53:53.805243 dv-cinder-855288-2-smb devstack@keystone.service[81469]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:53:53.844888 dv-cinder-855288-2-smb devstack@keystone.service[81469]: Python main interpreter initialized at 0x555bbab2e9c0 Aug 31 00:53:53.844888 dv-cinder-855288-2-smb devstack@keystone.service[81469]: python threads support enabled Aug 31 00:53:53.844888 dv-cinder-855288-2-smb devstack@keystone.service[81469]: your server socket listen backlog is limited to 100 connections Aug 31 00:53:53.844888 dv-cinder-855288-2-smb devstack@keystone.service[81469]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:53:53.845275 dv-cinder-855288-2-smb devstack@keystone.service[81469]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:53:53.845352 dv-cinder-855288-2-smb devstack@keystone.service[81469]: *** Operational MODE: preforking *** Aug 31 00:53:53.845598 dv-cinder-855288-2-smb devstack@keystone.service[81469]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:53:53.845598 dv-cinder-855288-2-smb devstack@keystone.service[81469]: spawned uWSGI master process (pid: 81469) Aug 31 00:53:53.845809 dv-cinder-855288-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 00:53:53.846587 dv-cinder-855288-2-smb devstack@keystone.service[81469]: spawned uWSGI worker 1 (pid: 81483, cores: 1) Aug 31 00:53:53.846841 dv-cinder-855288-2-smb devstack@keystone.service[81469]: spawned uWSGI worker 2 (pid: 81484, cores: 1) Aug 31 00:53:53.847693 dv-cinder-855288-2-smb devstack@keystone.service[81469]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:53:58.284056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:53:58.284056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: from cryptography.utils import int_from_bytes Aug 31 00:53:58.284900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:53:58.284900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: from cryptography.utils import int_from_bytes Aug 31 00:53:58.286193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:53:58.286193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: from cryptography.utils import int_from_bytes Aug 31 00:53:58.286686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:53:58.286686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: from cryptography.utils import int_from_bytes Aug 31 00:53:58.335182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:53:58.335358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:53:58.335560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] command line args: [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:53:58.335833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:53:58.335966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:53:58.336049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ================================================================================ {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:53:58.336167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:53:58.336254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] admin_token = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.336387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] command line args: [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:53:58.336515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] config_dir = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.336665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:53:58.336755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.336832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ================================================================================ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:53:58.336909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] config_source = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.337052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] debug = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.337129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] admin_token = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.337253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.338062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] config_dir = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.338062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.338256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] config_source = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.338357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.338459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] debug = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.338554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.338647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.338772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.338875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.338978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.339071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.339200 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.339308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.339417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] log_config_append = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.339517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.339616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.339710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.339803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] log_dir = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.339906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_config_append = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.340012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] log_file = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.340123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.340224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.340341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_dir = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.340341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.340534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.340656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.340738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.340815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.340934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.341013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.341134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.341218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.341296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.341414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.341489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.341608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.341690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.341849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.341937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.342099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.342233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.342318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.342647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.342811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.342889 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.343046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.343125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.343283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.343372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.343531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.343656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.343781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.344034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.344123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.344222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] publish_errors = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.344494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.344584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.344732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] publish_errors = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.344805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.344912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.344988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.345170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.345261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.345359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.345453 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.345608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.345693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] standard_threads = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.345845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.345922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346081 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] standard_threads = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] use_journal = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] use_json = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] use_stderr = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] use_journal = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.346980 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] use_syslog = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.347079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] use_json = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.347161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.347255 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] use_stderr = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.347400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.347485 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] use_syslog = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.347644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.347721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:53:58.347900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.347976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.348141 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.348228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.348417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.348507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.348662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.348739 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.348911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.348994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.349151 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.349227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.349399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.349475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.349637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.349721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.349888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.349965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.350124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.350199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.350373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.350459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.350610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.350686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.350858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.350939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.351095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.351179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.351336 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.351418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.351589 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.351664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.351829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.351982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.352081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.352158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.352330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.352418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.352595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.352718 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.352834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.352911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.353177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.353269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.353439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.354074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.354189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.354526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.354616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.354688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.354766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.354959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.356798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.356798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.356947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357328 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.357945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.358021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.358021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.358146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.358215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.358215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.358345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.358446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.358687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.358794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.358974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.359262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.359413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.359656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.359817 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.359893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.360146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.360253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.360422 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.360667 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.360745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.360910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.360989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.361150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.361237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.361393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.361470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.361638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.361715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.361894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.361980 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.362132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.362209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.362375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.362452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.362612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.362702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.362854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.363005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.363088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.363340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.363488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.363566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.363677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.363806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.363921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.364049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.364165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.364292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.364462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.364619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.364703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.364777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.365003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.365139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.365247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.365421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.365509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.365721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.365871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.366011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.366213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.366380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.366480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.366685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.366827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.366927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.367152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.367241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.367430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.367508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.367675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.367882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.367968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.368168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.368394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.368478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.368665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.368859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.368960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.369169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.369334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.369458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.369640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.369803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.369936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.370112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.370233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.370357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.370488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.370616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.370810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.370935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.371057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.371189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.371312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.371433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.371561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.371685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.371807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.371928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.372050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.372176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.372306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.372462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.372540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.372612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.372683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.372754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.372897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.372972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.373080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.373159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.373326 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.373403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.373574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.373662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.373819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.373899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.374061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.374145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.374296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.374381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.374530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.374608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.374764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.374842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.374998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.375090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.375239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.375324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.375472 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.375549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.375717 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.375803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.375959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.376034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.376214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.376296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.376483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.376573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.376719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.external = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.376805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.376957 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.377045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.377226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.377311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.377463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.external = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.377550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.377698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.377777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.password = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.377933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.token = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.378011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.378177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.378264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.378418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.378497 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.password = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.378669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.token = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.378745 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.378903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.378989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.379141 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.379219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.379394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.379473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.379629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.379715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.379870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.379949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.380120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.380198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.380378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.380473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.380623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.380703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.380869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.380948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.381117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.381204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.381362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.381441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.381608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.381685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.381855 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.381942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.382094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.382174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.382343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.382428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.382600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.382687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.382841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.382920 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.383096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.383174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.383361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.383448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.383622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.383704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.383860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.383937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.384102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.384189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.384552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.384685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.384802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.384911 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.385176 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.385276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.385352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.385425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.385525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.385605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.385761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.385869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.386013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.386113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.386256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.386372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.386515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.386616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.386756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.386869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.387014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.387093 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.387258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.387340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.387511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.387590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.387753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.387840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.388007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.388087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.388260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.388392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.388529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.388609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.388770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.388850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.389021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.389105 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.389257 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.389341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.389496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.389583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.389732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.389888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.389967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.390147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.390238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.390389 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.390467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.390628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.390707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.390867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.390954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.391120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.391205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.391378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.391542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.391621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.391797 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.391884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.392041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.392119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.392277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.392419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.392544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.392666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.392781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.392908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.393022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.393144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.393265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.393387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.393508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.393622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.393761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.393846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.393998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.394079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.394249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.394329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.394501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.394579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.394740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.394819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.394991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.395069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.395241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.395320 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.395476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.395556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.395716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.395795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.395950 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.396029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.396188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.396267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.396448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.396529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.396683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.396761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.396925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.397006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.397164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.397242 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.397410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.397492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.397653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.397733 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.397886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.397966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.398124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.398212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.398419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.398505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.398615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.398694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.398850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.398938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.399088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.399166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.399328 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.399407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.399564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.399650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.399801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.399880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.400609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.400739 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.400856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.400996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.401080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.401224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.401325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.401488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.401568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.401727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.401807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.401988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.402067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.402241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.402321 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.402479 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.402577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.402717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.402797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.402951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.403028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.403192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.403274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.403431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.403511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.403671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.403751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.403906 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.403986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.404155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.404233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.404412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.404498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.404666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.404747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.404907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.404986 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.405148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.405227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.405382 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.405461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.405616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.405694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.405865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.405943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.406108 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.406189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.406348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.406427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.406585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.406663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.406830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.406909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.407076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.407155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.407315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.407393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.407553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.407633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.407794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.407873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.408039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.408166 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.408262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.408439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.408525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.408680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.408759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.408925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.409017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.409173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.409253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.409429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.409508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.409681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.409773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.409919 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.409998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.410171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.410249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.410423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.410511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.410660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.410739 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.410912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.410994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.411154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.411308 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.411384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.411456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.411629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.411715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] role.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.411877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.411965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] role.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.412111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.412189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.412363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] role.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.412446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.412618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] role.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.412707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.412857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.412946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.413108 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.413187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.413359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.413439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.413610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.413688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.413858 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.413936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.414105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.414185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.414340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.414419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.414592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.414671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.414841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.414926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.415077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.415156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.415326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.415404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.416316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.416434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.416579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.416768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.416856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.416984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.417115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.417373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.417451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.417627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.417706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.417866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.417955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.418122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.418205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.418374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.418452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.418618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.418707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.418854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.418933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.419087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.419165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.419323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.419404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.419575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.419654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.419810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.419888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.420049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.420130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.420286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.420397 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.420556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.420633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.420791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.420880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.421032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.421117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.421273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.421352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.421523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.421604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.421757 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.421834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.421999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] token.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.422078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.422241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.422322 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.422482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.422560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.422728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.422805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.422974 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.423054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.423225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.423303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.423464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.423542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.423707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.423788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.423945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.424024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.424194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.424274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.424457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.424538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.424701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.424779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.424940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.425029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.425190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.425278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.425461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.425539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.425698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.425786 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.425946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.426026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.426186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.426273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.426430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.426510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.connection = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.426668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.426748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.426908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.426996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.427147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.427227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.427386 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.427466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.427625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.427712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.427862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.427941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.428100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.428177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.428346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.428440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.428602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.428682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.428838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.428917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.429083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.429170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.429314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.429393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.429557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.429637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.429794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.429884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.429960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:53:58.430031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.430264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.430509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.430748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:53:58.430922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:53:58.459157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.459291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.459393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.459476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.459637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.459716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.468766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.468952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.497455 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.497596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.497671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.497744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.551513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.551987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.601027 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.601265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.601977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.602216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.757469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.757641 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.757756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.757835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.757998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.758121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.758227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.758348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.758451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.758575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.758696 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.758856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.782646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.782857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.782932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.783005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.783080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.783178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.783308 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.783392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.783534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.783616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.783853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.783977 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.784059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.796352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.796555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.810424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.810602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.810673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.810749 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.810872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.810979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.811098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.811180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.811317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.811401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.811533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.811624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.811751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.811834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:53:58.829220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.829414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:53:58.829513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.829659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:53:58.829761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.829966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:53:58.830065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.830193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:53:58.830284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.830476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.830595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.830741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.831012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.831153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.831289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.831373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.841039 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.841222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.841322 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.841407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.841596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.841699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.841888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.842037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.849192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.849401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.852084 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.852258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.852440 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.852621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.852761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.852942 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.853551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.853684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.853862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.854011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.854140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.854265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.854410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.854542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.854679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.854811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.854940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.855070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.855199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.855337 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.855467 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.855695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.879046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.879817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.880623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.880916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.881333 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.881628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.885613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.885904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.886198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.886332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.886559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.886847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.892525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.892821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.893338 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.893639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.897087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.897392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.897693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.898246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.898344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.898432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.898510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.898572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.898572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.898715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.898820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.898903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.899103 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.901676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.901973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.902391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.918050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.918357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.922265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.922384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.922690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.925524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.925828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.926563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.929685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.929992 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.930077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.933882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.934985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.937270 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.937577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.937871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.938123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.938209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.938458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.938749 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.941227 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.941542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.941835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.942132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.942426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.942812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.954825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.955136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.955416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.955682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.958987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.959302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.959584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.959867 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.963389 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.965104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.966657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.966941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.967128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.969113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.969884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.970189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.970595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.970689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.970887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.970993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.971181 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.973576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.973887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.974179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.974470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.974770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.982990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.983295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.983821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.984116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.984444 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.984735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.985034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.986693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:58.986995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.987283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.987565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.987850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.988131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:58.988449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.000537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.003612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.004050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.006499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.007118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.007989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.009621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.009911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.010145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.010292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.011508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.013011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.013303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.013606 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.016746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.018237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.020119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.021273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.021574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.021658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.021868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.022158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.024478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.024775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.025620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.025893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.030627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.030924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.031210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.033777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.034075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.034359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.038117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.038408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.038697 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.038979 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.039267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.039547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.039826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.040115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.040424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.041266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.041770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:53:59.041916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.042055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.042194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.042376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.042505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.042635 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.042762 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.042892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.043123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.043421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.043706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.043993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.044268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.045758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.045758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.045758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.045939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:53:59.076877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555bbab2e9c0 pid: 81483 (default app) Aug 31 00:53:59.079787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555bbab2e9c0 pid: 81484 (default app) Aug 31 00:53:59.080533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8da2-71f6-460d-9689-422195e5ce8c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:53:59.080827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8da2-71f6-460d-9689-422195e5ce8c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:53:59.081104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8da2-71f6-460d-9689-422195e5ce8c None None] PATH_INFO: `/v3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:53:59.085389 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 791 bytes} [Wed Aug 31 00:53:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:05.787270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c648-6c90-422e-89c6-6b3d93e8a851 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:05.787820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c648-6c90-422e-89c6-6b3d93e8a851 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:05.787911 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c648-6c90-422e-89c6-6b3d93e8a851 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:05.793068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1/2] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:05.798344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:05.798885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:05.798885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:05.871880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: INFO dbcounter [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] Registered counter for database keystone Aug 31 00:54:05.891384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG oslo_db.sqlalchemy.engines [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:54:05.897711 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writer thread running {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:54:06.094167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG passlib.handlers.bcrypt [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81483) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:54:06.094481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG passlib.handlers.bcrypt [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81483) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:54:06.155122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:06.156792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:06.289908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 2/3] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:54:06.727213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c648-6c90-422e-89c6-6b3d93e8a851 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:06.803689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: INFO dbcounter [None req-e356c648-6c90-422e-89c6-6b3d93e8a851 None None] Registered counter for database keystone Aug 31 00:54:06.826904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG oslo_db.sqlalchemy.engines [None req-e356c648-6c90-422e-89c6-6b3d93e8a851 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:54:06.833287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writer thread running {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:54:06.954908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c648-6c90-422e-89c6-6b3d93e8a851 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:06.959293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1e094-14a7-42d8-a872-0795e92a4a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:06.959932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1e094-14a7-42d8-a872-0795e92a4a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:06.960212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1e094-14a7-42d8-a872-0795e92a4a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:06.960516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1e094-14a7-42d8-a872-0795e92a4a05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:06.970246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1e094-14a7-42d8-a872-0795e92a4a05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:07.022271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6a1e094-14a7-42d8-a872-0795e92a4a05 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:54:07.022528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1e094-14a7-42d8-a872-0795e92a4a05 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:07.033453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 2/4] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Aug 31 00:54:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:54:07.039460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:07.054526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d926a-3143-4249-9968-42afc023e2ae None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:07.059073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df6859-a808-4af0-ae1d-3c1b69faa77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:07.060192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df6859-a808-4af0-ae1d-3c1b69faa77c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:07.060512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df6859-a808-4af0-ae1d-3c1b69faa77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:07.060793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df6859-a808-4af0-ae1d-3c1b69faa77c admin admin] PATH_INFO: `/v3/projects/945912bdd11549de9a3f98d9095b0494` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:07.062349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df6859-a808-4af0-ae1d-3c1b69faa77c admin admin] RBAC: Authorizing `identity:get_project(project_id=945912bdd11549de9a3f98d9095b0494)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:07.123725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WARNING keystone.common.rbac_enforcer.enforcer [None req-14df6859-a808-4af0-ae1d-3c1b69faa77c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:54:07.124069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df6859-a808-4af0-ae1d-3c1b69faa77c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:07.128884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 3/5] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Aug 31 00:54:07 2022] GET /identity/v3/projects/945912bdd11549de9a3f98d9095b0494 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:09.078679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead13b9-b25e-426b-a8c8-20bb61c61780 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:09.079306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead13b9-b25e-426b-a8c8-20bb61c61780 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:09.079306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead13b9-b25e-426b-a8c8-20bb61c61780 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:09.083390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 3/6] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:09.089016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68b56-d0ea-450f-befd-becb6cacd27c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:09.089435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68b56-d0ea-450f-befd-becb6cacd27c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:09.089578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68b56-d0ea-450f-befd-becb6cacd27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:09.110350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-42c68b56-d0ea-450f-befd-becb6cacd27c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:09.111892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-42c68b56-d0ea-450f-befd-becb6cacd27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:09.120781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 4/7] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:54:09.387763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead13b9-b25e-426b-a8c8-20bb61c61780 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:09.400394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead13b9-b25e-426b-a8c8-20bb61c61780 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:09.404632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d7382-eca6-442a-978b-789a7051e7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:09.405230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d7382-eca6-442a-978b-789a7051e7af admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:09.405511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d7382-eca6-442a-978b-789a7051e7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:09.405783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d7382-eca6-442a-978b-789a7051e7af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:09.413308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d7382-eca6-442a-978b-789a7051e7af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:09.415057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d7382-eca6-442a-978b-789a7051e7af admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:09.424312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 4/8] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Aug 31 00:54:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:54:09.430037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68b56-d0ea-450f-befd-becb6cacd27c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:09.439376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68b56-d0ea-450f-befd-becb6cacd27c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:09.443741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95b65-fb8f-4633-a396-46d737742cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:09.444396 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95b65-fb8f-4633-a396-46d737742cff admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:09.444686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95b65-fb8f-4633-a396-46d737742cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:09.444964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95b65-fb8f-4633-a396-46d737742cff admin admin] PATH_INFO: `/v3/users/76669597ccb648f3a43d97e4bc8fbea8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:09.446272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95b65-fb8f-4633-a396-46d737742cff admin admin] RBAC: Authorizing `identity:get_user(user_id=76669597ccb648f3a43d97e4bc8fbea8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:09.448212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95b65-fb8f-4633-a396-46d737742cff admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:09.449796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 5/9] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Aug 31 00:54:09 2022] GET /identity/v3/users/76669597ccb648f3a43d97e4bc8fbea8 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:11.450146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d4bb1-55bd-4d4f-a49f-acc33090b69f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:11.450664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d4bb1-55bd-4d4f-a49f-acc33090b69f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:11.450664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d4bb1-55bd-4d4f-a49f-acc33090b69f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:11.451948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 5/10] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:11.457104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74303861-d413-41ed-8b83-cb40305c3f84 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:11.457540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74303861-d413-41ed-8b83-cb40305c3f84 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:11.457674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74303861-d413-41ed-8b83-cb40305c3f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:11.476082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-74303861-d413-41ed-8b83-cb40305c3f84 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:11.477297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-74303861-d413-41ed-8b83-cb40305c3f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:11.488752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a342741-1937-4ff3-b430-d8149b3f1b3c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:11.489038 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a342741-1937-4ff3-b430-d8149b3f1b3c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:11.489312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a342741-1937-4ff3-b430-d8149b3f1b3c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:11.490854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 6/11] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:11.498049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ec29-b3bb-4a24-8237-72af48ee0670 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:11.498336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ec29-b3bb-4a24-8237-72af48ee0670 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:11.498613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ec29-b3bb-4a24-8237-72af48ee0670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:11.539804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG passlib.handlers.bcrypt [None req-9567ec29-b3bb-4a24-8237-72af48ee0670 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81484) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:54:11.540198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG passlib.handlers.bcrypt [None req-9567ec29-b3bb-4a24-8237-72af48ee0670 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81484) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:54:11.562585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 6/12] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:11.591082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9567ec29-b3bb-4a24-8237-72af48ee0670 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:11.592988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9567ec29-b3bb-4a24-8237-72af48ee0670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:11.698771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 7/13] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:11.826944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74303861-d413-41ed-8b83-cb40305c3f84 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:11.852573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:11.971789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74303861-d413-41ed-8b83-cb40305c3f84 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:11.975711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567ec29-b3bb-4a24-8237-72af48ee0670 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:12.006975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db763b-6195-4335-8947-2acfe7398482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:12.007629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db763b-6195-4335-8947-2acfe7398482 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:12.007913 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db763b-6195-4335-8947-2acfe7398482 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:12.008194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db763b-6195-4335-8947-2acfe7398482 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:12.020509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db763b-6195-4335-8947-2acfe7398482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-89db763b-6195-4335-8947-2acfe7398482 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:12.030207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:12.031386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:12.032483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 7/14] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:54:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:12.037709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db763b-6195-4335-8947-2acfe7398482 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:12.081496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567ec29-b3bb-4a24-8237-72af48ee0670 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:12.083793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:12.120640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32987c0-d658-474f-bfb9-fd5a26d39334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:12.121512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32987c0-d658-474f-bfb9-fd5a26d39334 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:12.121798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32987c0-d658-474f-bfb9-fd5a26d39334 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:12.122079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32987c0-d658-474f-bfb9-fd5a26d39334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:12.122505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:12.144029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db763b-6195-4335-8947-2acfe7398482 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:12.182568 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ce41-62e4-4f0f-8835-41b060663275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:12.183217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ce41-62e4-4f0f-8835-41b060663275 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:12.183503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ce41-62e4-4f0f-8835-41b060663275 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:12.183776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ce41-62e4-4f0f-8835-41b060663275 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:12.184495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ce41-62e4-4f0f-8835-41b060663275 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:12.184800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ce41-62e4-4f0f-8835-41b060663275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:12.186207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ce41-62e4-4f0f-8835-41b060663275 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:12.193332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32987c0-d658-474f-bfb9-fd5a26d39334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:12.194867 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32987c0-d658-474f-bfb9-fd5a26d39334 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:12.198317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 8/15] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:12.203745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ce41-62e4-4f0f-8835-41b060663275 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:12.300721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 8/16] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:54:12.307044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32987c0-d658-474f-bfb9-fd5a26d39334 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:12.309908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:12.310415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ce41-62e4-4f0f-8835-41b060663275 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:12.346488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48046dd-2c83-4854-bc2a-0692888cbcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:12.347060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48046dd-2c83-4854-bc2a-0692888cbcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:12.347326 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48046dd-2c83-4854-bc2a-0692888cbcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:12.347601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48046dd-2c83-4854-bc2a-0692888cbcb9 None admin] PATH_INFO: `/v3/users/76669597ccb648f3a43d97e4bc8fbea8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:12.348787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48046dd-2c83-4854-bc2a-0692888cbcb9 None admin] RBAC: Authorizing `identity:get_user(user_id=76669597ccb648f3a43d97e4bc8fbea8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:12.350243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48046dd-2c83-4854-bc2a-0692888cbcb9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:12.351816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 9/17] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:12 2022] GET /identity/v3/users/76669597ccb648f3a43d97e4bc8fbea8 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:12.358117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48046dd-2c83-4854-bc2a-0692888cbcb9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:12.373334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:12.408507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32987c0-d658-474f-bfb9-fd5a26d39334 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:12.444189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb823de5-d619-42fe-ae83-4b4c99cea131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:12.445076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb823de5-d619-42fe-ae83-4b4c99cea131 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:12.445359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb823de5-d619-42fe-ae83-4b4c99cea131 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:12.445633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb823de5-d619-42fe-ae83-4b4c99cea131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:12.461317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48046dd-2c83-4854-bc2a-0692888cbcb9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:12.464713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb823de5-d619-42fe-ae83-4b4c99cea131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:12.466196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb823de5-d619-42fe-ae83-4b4c99cea131 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cb823de5-d619-42fe-ae83-4b4c99cea131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:54:12.484956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:12.485852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:54:12.486746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:54:12.486746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:54:12.486746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:12.486746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 9/18] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:54:12.491934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb823de5-d619-42fe-ae83-4b4c99cea131 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:12.498259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d78f2-7605-4113-9293-858b3d8f12df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:12.498908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d78f2-7605-4113-9293-858b3d8f12df None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:12.499192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d78f2-7605-4113-9293-858b3d8f12df None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:12.499470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d78f2-7605-4113-9293-858b3d8f12df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:12.500624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d78f2-7605-4113-9293-858b3d8f12df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:12.502082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d78f2-7605-4113-9293-858b3d8f12df None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:12.503619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 10/19] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:12.509232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d78f2-7605-4113-9293-858b3d8f12df None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:12.549240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:12.593816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:12.600140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb823de5-d619-42fe-ae83-4b4c99cea131 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:12.614307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d78f2-7605-4113-9293-858b3d8f12df None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:12.633146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0073b74-8fc2-4bbc-aa99-70d10c00f84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:12.633758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0073b74-8fc2-4bbc-aa99-70d10c00f84a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:12.634079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0073b74-8fc2-4bbc-aa99-70d10c00f84a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:12.634365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0073b74-8fc2-4bbc-aa99-70d10c00f84a None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:12.635009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0073b74-8fc2-4bbc-aa99-70d10c00f84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:12.635313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0073b74-8fc2-4bbc-aa99-70d10c00f84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:12.636779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0073b74-8fc2-4bbc-aa99-70d10c00f84a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:12.647715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03b1ef-abbd-404c-9d01-525576b9557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:12.648388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03b1ef-abbd-404c-9d01-525576b9557c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:12.648682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03b1ef-abbd-404c-9d01-525576b9557c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:12.648964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03b1ef-abbd-404c-9d01-525576b9557c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:12.650275 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03b1ef-abbd-404c-9d01-525576b9557c None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.domain.id=default, user.id=76669597ccb648f3a43d97e4bc8fbea8) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:12.650786 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03b1ef-abbd-404c-9d01-525576b9557c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:12.652357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03b1ef-abbd-404c-9d01-525576b9557c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:12.654431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 10/20] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:12.659221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 11/21] 10.222.0.83 () {56 vars in 1322 bytes} [Wed Aug 31 00:54:12 2022] GET /identity/v3/role_assignments?user.id=76669597ccb648f3a43d97e4bc8fbea8&scope.domain.id=default&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:15.135051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1837b4-a0fd-40b3-b10b-8a1946a6ae21 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:15.136067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1837b4-a0fd-40b3-b10b-8a1946a6ae21 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:15.136606 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1837b4-a0fd-40b3-b10b-8a1946a6ae21 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:15.138202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 11/22] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:15.143738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99aa3-0944-4416-90db-b274721c27a2 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:15.144630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99aa3-0944-4416-90db-b274721c27a2 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:15.145117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99aa3-0944-4416-90db-b274721c27a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:15.171642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b4d99aa3-0944-4416-90db-b274721c27a2 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:15.173239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b4d99aa3-0944-4416-90db-b274721c27a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:15.201859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e483a-4bdf-440e-bcbf-b427294f8bf0 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:15.202463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e483a-4bdf-440e-bcbf-b427294f8bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:15.202931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e483a-4bdf-440e-bcbf-b427294f8bf0 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:15.204648 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 12/23] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:15.209975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bf575-4fb8-44a7-9397-49ec8c2b23e9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:15.210525 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bf575-4fb8-44a7-9397-49ec8c2b23e9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:15.211000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bf575-4fb8-44a7-9397-49ec8c2b23e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:15.242185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e92bf575-4fb8-44a7-9397-49ec8c2b23e9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:15.245841 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e92bf575-4fb8-44a7-9397-49ec8c2b23e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:15.293062 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 12/24] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:15.361966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 13/25] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:15.429843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e4d74-885d-4344-b141-f5a9ee0b4f45 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:15.430153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e4d74-885d-4344-b141-f5a9ee0b4f45 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:15.430404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e4d74-885d-4344-b141-f5a9ee0b4f45 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:15.432028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 13/26] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:15.453703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4ce2-c002-462e-a684-4d8450ec49aa None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:15.454342 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4ce2-c002-462e-a684-4d8450ec49aa None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:15.454813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4ce2-c002-462e-a684-4d8450ec49aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:15.483118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-01dd4ce2-c002-462e-a684-4d8450ec49aa None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:15.484747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-01dd4ce2-c002-462e-a684-4d8450ec49aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:15.543371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:15.577903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 14/27] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:15.684996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e4d74-885d-4344-b141-f5a9ee0b4f45 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:15.783823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:15.819702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e4d74-885d-4344-b141-f5a9ee0b4f45 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:15.864163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ac8d8-2053-416e-9846-02050b666080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:15.864833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ac8d8-2053-416e-9846-02050b666080 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:15.865122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ac8d8-2053-416e-9846-02050b666080 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:15.865405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ac8d8-2053-416e-9846-02050b666080 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:15.866098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ac8d8-2053-416e-9846-02050b666080 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:15.867510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ac8d8-2053-416e-9846-02050b666080 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:15.906345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb01f-fe32-4512-8ec5-a9a76055ce6e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:15.906640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb01f-fe32-4512-8ec5-a9a76055ce6e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:15.906909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb01f-fe32-4512-8ec5-a9a76055ce6e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:15.908541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 15/28] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:15.913613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167275f-8e02-41cb-9436-61ba6a31fa60 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:15.913908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167275f-8e02-41cb-9436-61ba6a31fa60 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:15.914188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167275f-8e02-41cb-9436-61ba6a31fa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:15.949598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5167275f-8e02-41cb-9436-61ba6a31fa60 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:15.950992 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5167275f-8e02-41cb-9436-61ba6a31fa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:16.007249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 14/29] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Aug 31 00:54:15 2022] POST /identity/v3/roles => generated 225 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:16.010139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ac8d8-2053-416e-9846-02050b666080 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:16.107164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 16/30] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:16.107930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167275f-8e02-41cb-9436-61ba6a31fa60 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:16.178188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ac8d8-2053-416e-9846-02050b666080 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:16.219892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ae0c5-e907-4853-ab7c-c42664e808c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:16.220822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ae0c5-e907-4853-ab7c-c42664e808c8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:16.221263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ae0c5-e907-4853-ab7c-c42664e808c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:16.221736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ae0c5-e907-4853-ab7c-c42664e808c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:16.224226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:16.237144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ae0c5-e907-4853-ab7c-c42664e808c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-f10ae0c5-e907-4853-ab7c-c42664e808c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:16.242976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:16.244142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:16.245118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:16.247497 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 15/31] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:54:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:16.249237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb417d-6ccd-4ed2-830c-63fed8429ab0 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:16.249967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb417d-6ccd-4ed2-830c-63fed8429ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:16.250392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb417d-6ccd-4ed2-830c-63fed8429ab0 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:16.252025 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 16/32] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:16.257496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb417d-6ccd-4ed2-830c-63fed8429ab0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:16.271419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167275f-8e02-41cb-9436-61ba6a31fa60 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:16.280552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:16.312944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b6f9-20df-4148-8b99-076ff1068d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:16.313606 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b6f9-20df-4148-8b99-076ff1068d3d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:16.313894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b6f9-20df-4148-8b99-076ff1068d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:16.314178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b6f9-20df-4148-8b99-076ff1068d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:16.325623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1b6f9-20df-4148-8b99-076ff1068d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:16.327332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1b6f9-20df-4148-8b99-076ff1068d3d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1ae1b6f9-20df-4148-8b99-076ff1068d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:54:16.345052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:16.346154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:54:16.346969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:54:16.346969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:54:16.346969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:16.346969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 17/33] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:16.347433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2abea-73e6-4855-a793-83f63e8024f5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:16.347872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2abea-73e6-4855-a793-83f63e8024f5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:16.348156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2abea-73e6-4855-a793-83f63e8024f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:16.376224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-78b2abea-73e6-4855-a793-83f63e8024f5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:16.377769 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-78b2abea-73e6-4855-a793-83f63e8024f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:16.380670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb417d-6ccd-4ed2-830c-63fed8429ab0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:16.429865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2511ee-975f-40c1-9fa6-fc7ccfd97c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:16.430603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2511ee-975f-40c1-9fa6-fc7ccfd97c1c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:16.431534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2511ee-975f-40c1-9fa6-fc7ccfd97c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:16.431914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2511ee-975f-40c1-9fa6-fc7ccfd97c1c None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:16.432789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2511ee-975f-40c1-9fa6-fc7ccfd97c1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:16.433161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2511ee-975f-40c1-9fa6-fc7ccfd97c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:16.435466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2511ee-975f-40c1-9fa6-fc7ccfd97c1c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:16.446182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 17/34] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:16.447692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2511ee-975f-40c1-9fa6-fc7ccfd97c1c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:16.464138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 18/35] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:16.465017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2abea-73e6-4855-a793-83f63e8024f5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:16.517512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:16.572648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2511ee-975f-40c1-9fa6-fc7ccfd97c1c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:16.584603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:16.598912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2abea-73e6-4855-a793-83f63e8024f5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:16.617325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe35db5-3b5d-41a1-a0e8-efa6bc539f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:16.617949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe35db5-3b5d-41a1-a0e8-efa6bc539f7e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:16.618237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe35db5-3b5d-41a1-a0e8-efa6bc539f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:16.619179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe35db5-3b5d-41a1-a0e8-efa6bc539f7e None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:16.620033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe35db5-3b5d-41a1-a0e8-efa6bc539f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:16.620394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe35db5-3b5d-41a1-a0e8-efa6bc539f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:16.621817 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe35db5-3b5d-41a1-a0e8-efa6bc539f7e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:16.639105 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e76d-0df9-4755-a79d-f88d009d2d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:16.640143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e76d-0df9-4755-a79d-f88d009d2d04 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:16.640752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e76d-0df9-4755-a79d-f88d009d2d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:16.641234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e76d-0df9-4755-a79d-f88d009d2d04 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:16.642183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9e76d-0df9-4755-a79d-f88d009d2d04 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:16.642441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 18/36] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:16.643314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe35db5-3b5d-41a1-a0e8-efa6bc539f7e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:16.644369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9e76d-0df9-4755-a79d-f88d009d2d04 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:16.776802 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 19/37] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Aug 31 00:54:16 2022] POST /identity/v3/roles => generated 219 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:16.778385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e76d-0df9-4755-a79d-f88d009d2d04 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:16.878618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe35db5-3b5d-41a1-a0e8-efa6bc539f7e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:16.898002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:16.908877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e76d-0df9-4755-a79d-f88d009d2d04 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:16.919009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c729b3-0451-444d-84cb-8f7e1b904d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:16.919763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c729b3-0451-444d-84cb-8f7e1b904d2b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:16.920060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c729b3-0451-444d-84cb-8f7e1b904d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:16.920366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c729b3-0451-444d-84cb-8f7e1b904d2b None admin] PATH_INFO: `/v3/users/76669597ccb648f3a43d97e4bc8fbea8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:16.921657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c729b3-0451-444d-84cb-8f7e1b904d2b None admin] RBAC: Authorizing `identity:get_user(user_id=76669597ccb648f3a43d97e4bc8fbea8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:16.923107 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c729b3-0451-444d-84cb-8f7e1b904d2b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:16.925000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 19/38] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:16 2022] GET /identity/v3/users/76669597ccb648f3a43d97e4bc8fbea8 => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:16.925656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c729b3-0451-444d-84cb-8f7e1b904d2b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:16.958131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adb805-3d2e-49fb-857d-ffe02af03f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:16.958770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb805-3d2e-49fb-857d-ffe02af03f6b None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:16.959056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb805-3d2e-49fb-857d-ffe02af03f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:16.959334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb805-3d2e-49fb-857d-ffe02af03f6b None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:16.960247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adb805-3d2e-49fb-857d-ffe02af03f6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:16.962042 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adb805-3d2e-49fb-857d-ffe02af03f6b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:16.989538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:16.999102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 20/39] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:54:16 2022] POST /identity/v3/projects => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:17.000657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9125c0-ccde-49ed-949e-6eb4e3f7e93f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:17.000952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9125c0-ccde-49ed-949e-6eb4e3f7e93f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:17.001231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9125c0-ccde-49ed-949e-6eb4e3f7e93f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:17.002633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 21/40] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:17.003187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9125c0-ccde-49ed-949e-6eb4e3f7e93f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:17.052962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c729b3-0451-444d-84cb-8f7e1b904d2b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:17.099833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34685b6d-8a00-48c5-a630-0244bde0e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:17.100503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34685b6d-8a00-48c5-a630-0244bde0e698 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:17.100803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34685b6d-8a00-48c5-a630-0244bde0e698 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:17.101093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34685b6d-8a00-48c5-a630-0244bde0e698 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:17.101793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34685b6d-8a00-48c5-a630-0244bde0e698 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:17.103977 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34685b6d-8a00-48c5-a630-0244bde0e698 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:17.128511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 20/41] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Aug 31 00:54:16 2022] POST /identity/v3/roles => generated 223 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:17.128511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeabb8e-acbf-478e-b663-97878fa68ef0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:17.128511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeabb8e-acbf-478e-b663-97878fa68ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:17.128862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9125c0-ccde-49ed-949e-6eb4e3f7e93f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:17.128937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeabb8e-acbf-478e-b663-97878fa68ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:17.157458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-dbeabb8e-acbf-478e-b663-97878fa68ef0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:17.159104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dbeabb8e-acbf-478e-b663-97878fa68ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:17.187714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc51cc2-a14b-492d-b223-d8172f077daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:17.188414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc51cc2-a14b-492d-b223-d8172f077daa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:17.188692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc51cc2-a14b-492d-b223-d8172f077daa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:17.188971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc51cc2-a14b-492d-b223-d8172f077daa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:17.191316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc51cc2-a14b-492d-b223-d8172f077daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:17.191628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc51cc2-a14b-492d-b223-d8172f077daa None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:17.193996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 22/42] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:17.200029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc51cc2-a14b-492d-b223-d8172f077daa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:17.238038 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:17.274095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 21/43] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:17.290091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:17.329509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc51cc2-a14b-492d-b223-d8172f077daa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:17.367258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab77379-8176-4c75-9512-a3cfadb85715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:17.367931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab77379-8176-4c75-9512-a3cfadb85715 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:17.368218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab77379-8176-4c75-9512-a3cfadb85715 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:17.369079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab77379-8176-4c75-9512-a3cfadb85715 None admin] PATH_INFO: `/v3/domains/default/users/76669597ccb648f3a43d97e4bc8fbea8/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:17.371262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab77379-8176-4c75-9512-a3cfadb85715 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=76669597ccb648f3a43d97e4bc8fbea8, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:17.372805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab77379-8176-4c75-9512-a3cfadb85715 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:17.389206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 23/44] 10.222.0.83 () {58 vars in 1361 bytes} [Wed Aug 31 00:54:17 2022] PUT /identity/v3/domains/default/users/76669597ccb648f3a43d97e4bc8fbea8/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:54:17.552691 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeabb8e-acbf-478e-b663-97878fa68ef0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:17.656829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeabb8e-acbf-478e-b663-97878fa68ef0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:17.691509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583dc25-3cd4-4be3-bb06-9affac5b303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:17.692160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583dc25-3cd4-4be3-bb06-9affac5b303b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:17.692487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583dc25-3cd4-4be3-bb06-9affac5b303b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:17.692773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583dc25-3cd4-4be3-bb06-9affac5b303b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:17.693902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583dc25-3cd4-4be3-bb06-9affac5b303b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:17.695356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583dc25-3cd4-4be3-bb06-9affac5b303b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:17.697789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 22/45] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:17.703409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab77379-8176-4c75-9512-a3cfadb85715 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:17.804567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab77379-8176-4c75-9512-a3cfadb85715 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:17.831642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:17.841205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5de94-6043-45c5-8dfa-a9fbe062d975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:17.841827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5de94-6043-45c5-8dfa-a9fbe062d975 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:17.842107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5de94-6043-45c5-8dfa-a9fbe062d975 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:17.842644 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5de94-6043-45c5-8dfa-a9fbe062d975 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:17.843293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5de94-6043-45c5-8dfa-a9fbe062d975 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:17.844779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5de94-6043-45c5-8dfa-a9fbe062d975 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:17.871495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 24/46] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:54:17 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:19.282911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b368f-f111-4100-8e6f-ac51214e262c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:19.283422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b368f-f111-4100-8e6f-ac51214e262c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:19.283555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b368f-f111-4100-8e6f-ac51214e262c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:19.284936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 23/47] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:19.290909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58f92d-918c-4074-af7b-b5ef070dc4e5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:19.291542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58f92d-918c-4074-af7b-b5ef070dc4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:19.291956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58f92d-918c-4074-af7b-b5ef070dc4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:19.310093 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7e58f92d-918c-4074-af7b-b5ef070dc4e5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:19.311597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7e58f92d-918c-4074-af7b-b5ef070dc4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:19.378350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 25/48] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:19.644835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b368f-f111-4100-8e6f-ac51214e262c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:19.696256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:19.755839 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b368f-f111-4100-8e6f-ac51214e262c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:19.767447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e340d7e-2b5a-4190-9f52-6081b8aa7ae8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:19.767744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e340d7e-2b5a-4190-9f52-6081b8aa7ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:19.768026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e340d7e-2b5a-4190-9f52-6081b8aa7ae8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:19.769408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 26/49] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:19.774412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b62c2-d723-4f34-9945-eaa81d2ff9d2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:19.775360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b62c2-d723-4f34-9945-eaa81d2ff9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:19.775643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b62c2-d723-4f34-9945-eaa81d2ff9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:19.792050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef78072-f52d-4248-9fe4-214bdfd73eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:19.792720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef78072-f52d-4248-9fe4-214bdfd73eed None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:19.793041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef78072-f52d-4248-9fe4-214bdfd73eed None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:19.793277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef78072-f52d-4248-9fe4-214bdfd73eed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:19.794150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a97b62c2-d723-4f34-9945-eaa81d2ff9d2 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:19.795365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a97b62c2-d723-4f34-9945-eaa81d2ff9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:19.803541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef78072-f52d-4248-9fe4-214bdfd73eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-cef78072-f52d-4248-9fe4-214bdfd73eed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:19.808801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:19.809709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:19.810742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 24/50] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:54:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:19.815657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef78072-f52d-4248-9fe4-214bdfd73eed None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:19.867484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 27/51] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:19.922455 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef78072-f52d-4248-9fe4-214bdfd73eed None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:19.923919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:19.963319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14687df-e024-4085-b828-d4012ad16501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:19.964087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14687df-e024-4085-b828-d4012ad16501 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:19.964400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14687df-e024-4085-b828-d4012ad16501 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:19.964681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14687df-e024-4085-b828-d4012ad16501 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:19.965426 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14687df-e024-4085-b828-d4012ad16501 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:19.965733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14687df-e024-4085-b828-d4012ad16501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:19.967147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14687df-e024-4085-b828-d4012ad16501 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:19.975934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 25/52] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:19.982248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b62c2-d723-4f34-9945-eaa81d2ff9d2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:20.022696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:20.081164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b62c2-d723-4f34-9945-eaa81d2ff9d2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:20.115297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7c95-597a-42bc-8dcc-d05820dac91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:20.115943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7c95-597a-42bc-8dcc-d05820dac91d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:20.116226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7c95-597a-42bc-8dcc-d05820dac91d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:20.116531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7c95-597a-42bc-8dcc-d05820dac91d None admin] PATH_INFO: `/v3/users/76669597ccb648f3a43d97e4bc8fbea8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:20.117649 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e7c95-597a-42bc-8dcc-d05820dac91d None admin] RBAC: Authorizing `identity:get_user(user_id=76669597ccb648f3a43d97e4bc8fbea8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:20.119247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e7c95-597a-42bc-8dcc-d05820dac91d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:20.120844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 28/53] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:19 2022] GET /identity/v3/users/76669597ccb648f3a43d97e4bc8fbea8 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:20.126375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14687df-e024-4085-b828-d4012ad16501 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:20.146068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7c95-597a-42bc-8dcc-d05820dac91d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:20.230812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14687df-e024-4085-b828-d4012ad16501 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:20.246413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7c95-597a-42bc-8dcc-d05820dac91d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:20.265767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcae9bc-4a2a-48af-b239-71bdeb592173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:20.266442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcae9bc-4a2a-48af-b239-71bdeb592173 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:20.266718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcae9bc-4a2a-48af-b239-71bdeb592173 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:20.266995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcae9bc-4a2a-48af-b239-71bdeb592173 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:20.268203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcae9bc-4a2a-48af-b239-71bdeb592173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:20.269746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcae9bc-4a2a-48af-b239-71bdeb592173 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:20.271421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 26/54] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:20.278396 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcae9bc-4a2a-48af-b239-71bdeb592173 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:20.314000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:20.361320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:20.388264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b21c4-c4bb-49da-ac82-b7f5478f860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:20.388519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcae9bc-4a2a-48af-b239-71bdeb592173 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:20.388937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b21c4-c4bb-49da-ac82-b7f5478f860a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:20.389226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b21c4-c4bb-49da-ac82-b7f5478f860a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:20.389507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b21c4-c4bb-49da-ac82-b7f5478f860a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:20.390637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b21c4-c4bb-49da-ac82-b7f5478f860a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:20.392074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b21c4-c4bb-49da-ac82-b7f5478f860a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:20.393680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 29/55] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:20.399283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b21c4-c4bb-49da-ac82-b7f5478f860a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:20.422966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b80473-ed57-4248-a91c-386a3341b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:20.423586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b80473-ed57-4248-a91c-386a3341b362 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:20.423878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b80473-ed57-4248-a91c-386a3341b362 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:20.424155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b80473-ed57-4248-a91c-386a3341b362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:20.424925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b80473-ed57-4248-a91c-386a3341b362 None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.domain.id=default, user.id=76669597ccb648f3a43d97e4bc8fbea8) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:20.425235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b80473-ed57-4248-a91c-386a3341b362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:20.426703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b80473-ed57-4248-a91c-386a3341b362 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:20.433716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 27/56] 10.222.0.83 () {56 vars in 1322 bytes} [Wed Aug 31 00:54:20 2022] GET /identity/v3/role_assignments?user.id=76669597ccb648f3a43d97e4bc8fbea8&scope.domain.id=default&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:20.512120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b21c4-c4bb-49da-ac82-b7f5478f860a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:20.548942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea52ea-cff1-4abd-be00-66255167314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:20.549522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea52ea-cff1-4abd-be00-66255167314b None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:20.549806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea52ea-cff1-4abd-be00-66255167314b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:20.550084 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea52ea-cff1-4abd-be00-66255167314b None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:20.550758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea52ea-cff1-4abd-be00-66255167314b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:20.552234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea52ea-cff1-4abd-be00-66255167314b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:20.581615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 30/57] 10.222.0.83 () {60 vars in 1140 bytes} [Wed Aug 31 00:54:20 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:54:22.548458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57908856-941c-443f-914e-29f7ba485c4f None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:22.548968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57908856-941c-443f-914e-29f7ba485c4f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:22.548968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57908856-941c-443f-914e-29f7ba485c4f None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:22.550293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 28/58] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:22.555491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8764-424b-4105-a569-6cd43515ce78 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:22.555958 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8764-424b-4105-a569-6cd43515ce78 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:22.556077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8764-424b-4105-a569-6cd43515ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:22.575018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a96c8764-424b-4105-a569-6cd43515ce78 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:22.576229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a96c8764-424b-4105-a569-6cd43515ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:22.600766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:22.660570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 31/59] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:22.935924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57908856-941c-443f-914e-29f7ba485c4f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:23.035929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:23.043416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57908856-941c-443f-914e-29f7ba485c4f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:23.080102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556aac5-f397-4842-ab73-f4773e3459e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:23.080771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556aac5-f397-4842-ab73-f4773e3459e9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:23.081060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556aac5-f397-4842-ab73-f4773e3459e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:23.081342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556aac5-f397-4842-ab73-f4773e3459e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:23.082477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556aac5-f397-4842-ab73-f4773e3459e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:23.083950 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556aac5-f397-4842-ab73-f4773e3459e9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:23.085576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 29/60] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:23.091600 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c8764-424b-4105-a569-6cd43515ce78 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:23.195425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c8764-424b-4105-a569-6cd43515ce78 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:23.231339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3372c6f-ecfa-4979-b970-da2ca6d8298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:23.231955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3372c6f-ecfa-4979-b970-da2ca6d8298b None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:23.232240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3372c6f-ecfa-4979-b970-da2ca6d8298b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:23.232546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3372c6f-ecfa-4979-b970-da2ca6d8298b None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:23.233212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3372c6f-ecfa-4979-b970-da2ca6d8298b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:23.235591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3372c6f-ecfa-4979-b970-da2ca6d8298b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:23.263897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 32/61] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:54:23 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:54:26.378262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6c40d-2d50-457d-aa56-5e0c66476df0 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:26.379264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6c40d-2d50-457d-aa56-5e0c66476df0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:26.379790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6c40d-2d50-457d-aa56-5e0c66476df0 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:26.381448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 30/62] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:26.387625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0496e-7471-416c-a556-1754dec6b4df None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:26.388550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0496e-7471-416c-a556-1754dec6b4df None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:26.389034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0496e-7471-416c-a556-1754dec6b4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:26.416650 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6fb0496e-7471-416c-a556-1754dec6b4df None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:26.418149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6fb0496e-7471-416c-a556-1754dec6b4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:26.433200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:26.528552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 33/63] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:26.669947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce5531-1c06-46e2-a113-21294bc75038 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:26.670180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce5531-1c06-46e2-a113-21294bc75038 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:26.670435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce5531-1c06-46e2-a113-21294bc75038 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:26.671755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 31/64] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:26.677504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9798-2cc8-4e31-8c9e-968c4dc02d8e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:26.677823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9798-2cc8-4e31-8c9e-968c4dc02d8e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:26.678070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9798-2cc8-4e31-8c9e-968c4dc02d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:26.702392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-375f9798-2cc8-4e31-8c9e-968c4dc02d8e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:26.703604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-375f9798-2cc8-4e31-8c9e-968c4dc02d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:26.779433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 34/65] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:26.822846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864c6ba-4f6c-4a2d-b48c-752e199cbc69 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:26.823227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864c6ba-4f6c-4a2d-b48c-752e199cbc69 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:26.823491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864c6ba-4f6c-4a2d-b48c-752e199cbc69 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:26.825092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 32/66] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:26.830236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd806526-aa64-463f-86dc-1cbd72226c7d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:26.830516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd806526-aa64-463f-86dc-1cbd72226c7d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:26.830797 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd806526-aa64-463f-86dc-1cbd72226c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:26.852436 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fd806526-aa64-463f-86dc-1cbd72226c7d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:26.853852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fd806526-aa64-463f-86dc-1cbd72226c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:26.950382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 35/67] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:27.062532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864c6ba-4f6c-4a2d-b48c-752e199cbc69 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:27.141695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9ecc6-2ad6-4f1b-a328-bcbf135db54a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.142399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9ecc6-2ad6-4f1b-a328-bcbf135db54a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.142883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9ecc6-2ad6-4f1b-a328-bcbf135db54a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:27.149502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 36/68] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:27.155854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca468e-c950-4dc9-8cab-cd28e1f40189 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.156410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca468e-c950-4dc9-8cab-cd28e1f40189 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.157031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca468e-c950-4dc9-8cab-cd28e1f40189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:27.171307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:27.193871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-76ca468e-c950-4dc9-8cab-cd28e1f40189 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:27.195879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-76ca468e-c950-4dc9-8cab-cd28e1f40189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:27.200886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864c6ba-4f6c-4a2d-b48c-752e199cbc69 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:27.244009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb958b-06f7-46b1-b317-8e9afaeea1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:27.244768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb958b-06f7-46b1-b317-8e9afaeea1de None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.245056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb958b-06f7-46b1-b317-8e9afaeea1de None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.245335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb958b-06f7-46b1-b317-8e9afaeea1de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:27.271028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb958b-06f7-46b1-b317-8e9afaeea1de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-eabb958b-06f7-46b1-b317-8e9afaeea1de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:27.280271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:27.281142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:27.281880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:27.283018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 33/69] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:27.288297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb958b-06f7-46b1-b317-8e9afaeea1de None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:27.320673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 37/70] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:27.322512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca468e-c950-4dc9-8cab-cd28e1f40189 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:27.326338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:27.441135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb958b-06f7-46b1-b317-8e9afaeea1de None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:27.448466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca468e-c950-4dc9-8cab-cd28e1f40189 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:27.493646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2781a6d-9a27-42dd-866c-da6e39ad62cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:27.494726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2781a6d-9a27-42dd-866c-da6e39ad62cd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.495052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2781a6d-9a27-42dd-866c-da6e39ad62cd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.495406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2781a6d-9a27-42dd-866c-da6e39ad62cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:27.512600 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed7d9c-ae0a-45cf-bd4a-adbfa1078533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:27.513240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed7d9c-ae0a-45cf-bd4a-adbfa1078533 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.513527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed7d9c-ae0a-45cf-bd4a-adbfa1078533 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.513812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed7d9c-ae0a-45cf-bd4a-adbfa1078533 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:27.514570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed7d9c-ae0a-45cf-bd4a-adbfa1078533 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:27.514893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed7d9c-ae0a-45cf-bd4a-adbfa1078533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:27.515428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2781a6d-9a27-42dd-866c-da6e39ad62cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:27.516301 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed7d9c-ae0a-45cf-bd4a-adbfa1078533 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:27.518470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-a2781a6d-9a27-42dd-866c-da6e39ad62cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:27.520414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:27.521293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:27.522124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 34/71] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:54:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:27.528215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa5a9b-c5c3-4336-85ae-d077905e3abe None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.528215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa5a9b-c5c3-4336-85ae-d077905e3abe None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.528215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa5a9b-c5c3-4336-85ae-d077905e3abe None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:27.528215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 35/72] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:27.528215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa5a9b-c5c3-4336-85ae-d077905e3abe None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:27.538592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 38/73] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:27.546432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed7d9c-ae0a-45cf-bd4a-adbfa1078533 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:27.628487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:27.650142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa5a9b-c5c3-4336-85ae-d077905e3abe None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:27.673597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed7d9c-ae0a-45cf-bd4a-adbfa1078533 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:27.686528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace03b90-afa1-4958-bb2b-c83d061ca714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:27.687172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace03b90-afa1-4958-bb2b-c83d061ca714 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.687456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace03b90-afa1-4958-bb2b-c83d061ca714 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.687733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace03b90-afa1-4958-bb2b-c83d061ca714 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:27.698161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace03b90-afa1-4958-bb2b-c83d061ca714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ace03b90-afa1-4958-bb2b-c83d061ca714 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:27.703135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:27.704582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 36/74] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:54:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:27.705543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d9e81-53cc-439a-9cb8-97c99cba5507 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.706413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d9e81-53cc-439a-9cb8-97c99cba5507 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.706413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d9e81-53cc-439a-9cb8-97c99cba5507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:27.711767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1c026-77ac-454a-a326-db7342f5debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:27.713027 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1c026-77ac-454a-a326-db7342f5debf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.713303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1c026-77ac-454a-a326-db7342f5debf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.713586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1c026-77ac-454a-a326-db7342f5debf None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:27.714250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1c026-77ac-454a-a326-db7342f5debf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:27.714556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1c026-77ac-454a-a326-db7342f5debf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:27.715939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1c026-77ac-454a-a326-db7342f5debf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:27.724623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 39/75] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:54:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:27.725279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1c026-77ac-454a-a326-db7342f5debf None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:27.725793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5d3d9e81-53cc-439a-9cb8-97c99cba5507 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:27.727018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5d3d9e81-53cc-439a-9cb8-97c99cba5507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:27.795249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 37/76] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:27.796030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d9e81-53cc-439a-9cb8-97c99cba5507 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:27.802062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:27.857537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1c026-77ac-454a-a326-db7342f5debf None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:27.895814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dfed7-8f9a-4971-a814-3843fca7b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:27.896499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dfed7-8f9a-4971-a814-3843fca7b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.896793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dfed7-8f9a-4971-a814-3843fca7b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.897076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dfed7-8f9a-4971-a814-3843fca7b4f8 None admin] PATH_INFO: `/v3/users/2e97a0404fba471486325b37a982a862` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:27.915180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8dfed7-8f9a-4971-a814-3843fca7b4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=2e97a0404fba471486325b37a982a862)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:27.916725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8dfed7-8f9a-4971-a814-3843fca7b4f8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:27.917630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:27.923607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 40/77] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:27 2022] GET /identity/v3/users/2e97a0404fba471486325b37a982a862 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:27.923607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dfed7-8f9a-4971-a814-3843fca7b4f8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:27.951185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d9e81-53cc-439a-9cb8-97c99cba5507 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:27.992572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc5247-bf8c-4cd3-87cf-f075ec8e71d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:27.994370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5247-bf8c-4cd3-87cf-f075ec8e71d1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:27.994747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5247-bf8c-4cd3-87cf-f075ec8e71d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:27.995036 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5247-bf8c-4cd3-87cf-f075ec8e71d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.005377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc5247-bf8c-4cd3-87cf-f075ec8e71d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-34bc5247-bf8c-4cd3-87cf-f075ec8e71d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:28.011990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:28.012923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:28.013679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 38/78] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:28.014298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc5247-bf8c-4cd3-87cf-f075ec8e71d1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:28.057250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dfed7-8f9a-4971-a814-3843fca7b4f8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:28.076227 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:28.096764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636733c-5e93-439a-ba0d-835d596cc049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:28.097387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636733c-5e93-439a-ba0d-835d596cc049 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:28.097675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636733c-5e93-439a-ba0d-835d596cc049 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:28.097956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636733c-5e93-439a-ba0d-835d596cc049 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.098627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636733c-5e93-439a-ba0d-835d596cc049 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:28.098941 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636733c-5e93-439a-ba0d-835d596cc049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:28.100355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636733c-5e93-439a-ba0d-835d596cc049 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:28.109186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 41/79] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:28.109953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636733c-5e93-439a-ba0d-835d596cc049 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:28.131893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc5247-bf8c-4cd3-87cf-f075ec8e71d1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:28.173552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbac1f9-256e-476f-9ae8-c7564cdc6431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:28.174207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbac1f9-256e-476f-9ae8-c7564cdc6431 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:28.174496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbac1f9-256e-476f-9ae8-c7564cdc6431 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:28.174774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbac1f9-256e-476f-9ae8-c7564cdc6431 None admin] PATH_INFO: `/v3/users/2e97a0404fba471486325b37a982a862` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.175968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbac1f9-256e-476f-9ae8-c7564cdc6431 None admin] RBAC: Authorizing `identity:get_user(user_id=2e97a0404fba471486325b37a982a862)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:28.177466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbac1f9-256e-476f-9ae8-c7564cdc6431 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:28.179336 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 39/80] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:28 2022] GET /identity/v3/users/2e97a0404fba471486325b37a982a862 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:28.180016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbac1f9-256e-476f-9ae8-c7564cdc6431 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:28.183642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:28.229338 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636733c-5e93-439a-ba0d-835d596cc049 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:28.266828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a49df-b34f-4b5a-8c2b-d9792127be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:28.267451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a49df-b34f-4b5a-8c2b-d9792127be7f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:28.267733 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a49df-b34f-4b5a-8c2b-d9792127be7f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:28.268011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a49df-b34f-4b5a-8c2b-d9792127be7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.287790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbac1f9-256e-476f-9ae8-c7564cdc6431 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:28.318904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:28.323966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9c483-80f4-4996-bb62-642b0e993767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:28.324626 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9c483-80f4-4996-bb62-642b0e993767 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:28.324914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9c483-80f4-4996-bb62-642b0e993767 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:28.325198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9c483-80f4-4996-bb62-642b0e993767 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.325881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9c483-80f4-4996-bb62-642b0e993767 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:28.326194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9c483-80f4-4996-bb62-642b0e993767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:28.327586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9c483-80f4-4996-bb62-642b0e993767 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:28.337050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 40/81] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:28.342568 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9c483-80f4-4996-bb62-642b0e993767 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:28.348926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a49df-b34f-4b5a-8c2b-d9792127be7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:28.348926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a49df-b34f-4b5a-8c2b-d9792127be7f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:28.410529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:28.459045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9c483-80f4-4996-bb62-642b0e993767 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:28.461517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 42/82] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:28.463419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a49df-b34f-4b5a-8c2b-d9792127be7f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:28.501048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a5b78-74a6-4a3c-9c32-ce7f8b4bf51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:28.501714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a5b78-74a6-4a3c-9c32-ce7f8b4bf51b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:28.502010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a5b78-74a6-4a3c-9c32-ce7f8b4bf51b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:28.502296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a5b78-74a6-4a3c-9c32-ce7f8b4bf51b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.503482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a5b78-74a6-4a3c-9c32-ce7f8b4bf51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:28.504997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a5b78-74a6-4a3c-9c32-ce7f8b4bf51b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:28.506668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 41/83] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:28.507490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a5b78-74a6-4a3c-9c32-ce7f8b4bf51b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:28.558306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:28.580772 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a49df-b34f-4b5a-8c2b-d9792127be7f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:28.616627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf872-f0ec-4127-8487-2cd4e9a9c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:28.617277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf872-f0ec-4127-8487-2cd4e9a9c286 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:28.617567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf872-f0ec-4127-8487-2cd4e9a9c286 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:28.617848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf872-f0ec-4127-8487-2cd4e9a9c286 None admin] PATH_INFO: `/v3/users/76669597ccb648f3a43d97e4bc8fbea8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.618434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a5b78-74a6-4a3c-9c32-ce7f8b4bf51b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:28.619104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaf872-f0ec-4127-8487-2cd4e9a9c286 None admin] RBAC: Authorizing `identity:get_user(user_id=76669597ccb648f3a43d97e4bc8fbea8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:28.620621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaf872-f0ec-4127-8487-2cd4e9a9c286 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:28.622391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 43/84] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:28 2022] GET /identity/v3/users/76669597ccb648f3a43d97e4bc8fbea8 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:28.623070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf872-f0ec-4127-8487-2cd4e9a9c286 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:28.648510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:28.654713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c789d-f623-4b26-a4b2-b479ffc1dfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:28.655345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c789d-f623-4b26-a4b2-b479ffc1dfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:28.655636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c789d-f623-4b26-a4b2-b479ffc1dfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:28.655918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c789d-f623-4b26-a4b2-b479ffc1dfe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.733194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c789d-f623-4b26-a4b2-b479ffc1dfe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:28.733716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf872-f0ec-4127-8487-2cd4e9a9c286 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:28.734680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c789d-f623-4b26-a4b2-b479ffc1dfe9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:28.769212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0b30-1983-49f1-9147-5875122fc49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:28.769858 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0b30-1983-49f1-9147-5875122fc49f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:28.770147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0b30-1983-49f1-9147-5875122fc49f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:28.770428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0b30-1983-49f1-9147-5875122fc49f None admin] PATH_INFO: `/v3/users/2e97a0404fba471486325b37a982a862` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.771581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e0b30-1983-49f1-9147-5875122fc49f None admin] RBAC: Authorizing `identity:get_user(user_id=2e97a0404fba471486325b37a982a862)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:28.773083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e0b30-1983-49f1-9147-5875122fc49f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:28.775343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 44/85] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:28 2022] GET /identity/v3/users/2e97a0404fba471486325b37a982a862 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:28.776214 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0b30-1983-49f1-9147-5875122fc49f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:28.793287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:28.838076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 42/86] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:28.838718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c789d-f623-4b26-a4b2-b479ffc1dfe9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:28.871288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:28.879568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0b30-1983-49f1-9147-5875122fc49f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:28.913136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9beb1-3e92-4fcf-a628-dce653020271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:28.913783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9beb1-3e92-4fcf-a628-dce653020271 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:28.914074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9beb1-3e92-4fcf-a628-dce653020271 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:28.914358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9beb1-3e92-4fcf-a628-dce653020271 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.916104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9beb1-3e92-4fcf-a628-dce653020271 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:28.917607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9beb1-3e92-4fcf-a628-dce653020271 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:28.919412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 45/87] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:28 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:28.920105 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9beb1-3e92-4fcf-a628-dce653020271 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:28.941456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c789d-f623-4b26-a4b2-b479ffc1dfe9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:28.976945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308e722-76e1-4e52-b0d6-ad8e7d909005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:28.977587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e722-76e1-4e52-b0d6-ad8e7d909005 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:28.977881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e722-76e1-4e52-b0d6-ad8e7d909005 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:28.978190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e722-76e1-4e52-b0d6-ad8e7d909005 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:28.978813 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308e722-76e1-4e52-b0d6-ad8e7d909005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:28.980266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308e722-76e1-4e52-b0d6-ad8e7d909005 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:29.003809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:29.007726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 43/88] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:54:28 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:29.009450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308e722-76e1-4e52-b0d6-ad8e7d909005 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:29.045189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9beb1-3e92-4fcf-a628-dce653020271 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:29.091058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530943b-da64-4e39-ba13-d06c060823c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:29.091721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530943b-da64-4e39-ba13-d06c060823c9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:29.092009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530943b-da64-4e39-ba13-d06c060823c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:29.092591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530943b-da64-4e39-ba13-d06c060823c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:29.118784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:29.142223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308e722-76e1-4e52-b0d6-ad8e7d909005 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:29.186379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530943b-da64-4e39-ba13-d06c060823c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:29.188200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530943b-da64-4e39-ba13-d06c060823c9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:29.195565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892e8a4-c75f-45c2-b662-aaa8d52d4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:29.196261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e8a4-c75f-45c2-b662-aaa8d52d4258 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:29.197160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e8a4-c75f-45c2-b662-aaa8d52d4258 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:29.197692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e8a4-c75f-45c2-b662-aaa8d52d4258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:29.292362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892e8a4-c75f-45c2-b662-aaa8d52d4258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:29.293902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892e8a4-c75f-45c2-b662-aaa8d52d4258 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:29.303791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:29.334672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 46/89] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:29.334672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530943b-da64-4e39-ba13-d06c060823c9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:29.424827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:29.442466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 44/90] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:29.443972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892e8a4-c75f-45c2-b662-aaa8d52d4258 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:29.470798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530943b-da64-4e39-ba13-d06c060823c9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:29.514576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126897e7-5f8d-41d0-80d5-a5e690999272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:29.515699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126897e7-5f8d-41d0-80d5-a5e690999272 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:29.516207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126897e7-5f8d-41d0-80d5-a5e690999272 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:29.516785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126897e7-5f8d-41d0-80d5-a5e690999272 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:29.518178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126897e7-5f8d-41d0-80d5-a5e690999272 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:29.520041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126897e7-5f8d-41d0-80d5-a5e690999272 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:29.522244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 47/91] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:29 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:29.523234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126897e7-5f8d-41d0-80d5-a5e690999272 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:29.595785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:29.597059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892e8a4-c75f-45c2-b662-aaa8d52d4258 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:29.648760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00122f70-e04d-4d54-b89b-321cc2b9d9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:29.649862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00122f70-e04d-4d54-b89b-321cc2b9d9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:29.650393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00122f70-e04d-4d54-b89b-321cc2b9d9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:29.650891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00122f70-e04d-4d54-b89b-321cc2b9d9e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:29.652161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00122f70-e04d-4d54-b89b-321cc2b9d9e1 None admin] RBAC: Adding query filter params (role.id=2db61e25a9cb41608fb5c1dd7983e1d9, scope.project.id=63e130b98cab47d38aafc327c5475d29, user.id=2e97a0404fba471486325b37a982a862) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:29.652578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00122f70-e04d-4d54-b89b-321cc2b9d9e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:29.654148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00122f70-e04d-4d54-b89b-321cc2b9d9e1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:29.660996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 45/92] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:29 2022] GET /identity/v3/role_assignments?user.id=2e97a0404fba471486325b37a982a862&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:29.661696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126897e7-5f8d-41d0-80d5-a5e690999272 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:29.662139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00122f70-e04d-4d54-b89b-321cc2b9d9e1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:29.730427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fbeae-28cd-41fa-bad8-8c90b79df24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:29.731633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fbeae-28cd-41fa-bad8-8c90b79df24f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:29.732100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fbeae-28cd-41fa-bad8-8c90b79df24f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:29.737262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fbeae-28cd-41fa-bad8-8c90b79df24f None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:29.739026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fbeae-28cd-41fa-bad8-8c90b79df24f None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:29.740821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fbeae-28cd-41fa-bad8-8c90b79df24f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:29.746484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 48/93] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:29 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:29.747710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fbeae-28cd-41fa-bad8-8c90b79df24f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:29.773601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:29.862088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00122f70-e04d-4d54-b89b-321cc2b9d9e1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:29.909195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ecdd-3cc4-45d4-ac6c-6c63e3782fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:29.909865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ecdd-3cc4-45d4-ac6c-6c63e3782fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:29.910154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ecdd-3cc4-45d4-ac6c-6c63e3782fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:29.910452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ecdd-3cc4-45d4-ac6c-6c63e3782fd8 None admin] PATH_INFO: `/v3/projects/529a6c2a98614f1ba403d29f1b7423bd` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:29.917139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416ecdd-3cc4-45d4-ac6c-6c63e3782fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=529a6c2a98614f1ba403d29f1b7423bd)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:29.918637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416ecdd-3cc4-45d4-ac6c-6c63e3782fd8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:29.920379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 46/94] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:29 2022] GET /identity/v3/projects/529a6c2a98614f1ba403d29f1b7423bd => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:29.921182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ecdd-3cc4-45d4-ac6c-6c63e3782fd8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:29.923059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fbeae-28cd-41fa-bad8-8c90b79df24f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:29.944749 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:29.968373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93f2e-c634-4dd9-b060-c81ba7229331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:29.969429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93f2e-c634-4dd9-b060-c81ba7229331 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:29.970964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93f2e-c634-4dd9-b060-c81ba7229331 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:29.971471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93f2e-c634-4dd9-b060-c81ba7229331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:29.972451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93f2e-c634-4dd9-b060-c81ba7229331 None admin] RBAC: Adding query filter params (role.id=5923fa436ead4ac4b096b40af8672f94, scope.project.id=63e130b98cab47d38aafc327c5475d29, user.id=2e97a0404fba471486325b37a982a862) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:29.972957 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93f2e-c634-4dd9-b060-c81ba7229331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:29.974968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93f2e-c634-4dd9-b060-c81ba7229331 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:29.988748 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 49/95] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:29 2022] GET /identity/v3/role_assignments?user.id=2e97a0404fba471486325b37a982a862&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=5923fa436ead4ac4b096b40af8672f94 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:29.994390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93f2e-c634-4dd9-b060-c81ba7229331 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:30.229747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ecdd-3cc4-45d4-ac6c-6c63e3782fd8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:30.233879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93f2e-c634-4dd9-b060-c81ba7229331 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:30.265763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:30.320535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833985d1-e982-4052-aaaf-348013d4f2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:30.321203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833985d1-e982-4052-aaaf-348013d4f2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:30.321508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833985d1-e982-4052-aaaf-348013d4f2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:30.321994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833985d1-e982-4052-aaaf-348013d4f2c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:30.322750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833985d1-e982-4052-aaaf-348013d4f2c0 None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=63e130b98cab47d38aafc327c5475d29, user.id=76669597ccb648f3a43d97e4bc8fbea8) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:30.323071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833985d1-e982-4052-aaaf-348013d4f2c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:30.324606 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833985d1-e982-4052-aaaf-348013d4f2c0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:30.330527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818fa5d-bd0b-4820-9ab2-929f04071a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:30.331161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818fa5d-bd0b-4820-9ab2-929f04071a6f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:30.331450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818fa5d-bd0b-4820-9ab2-929f04071a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:30.331730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818fa5d-bd0b-4820-9ab2-929f04071a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:30.332506 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818fa5d-bd0b-4820-9ab2-929f04071a6f None admin] RBAC: Adding query filter params (role.id=2db61e25a9cb41608fb5c1dd7983e1d9, scope.project.id=529a6c2a98614f1ba403d29f1b7423bd, user.id=2e97a0404fba471486325b37a982a862) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:30.332827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818fa5d-bd0b-4820-9ab2-929f04071a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:30.334298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818fa5d-bd0b-4820-9ab2-929f04071a6f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:30.347106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 47/96] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:29 2022] GET /identity/v3/role_assignments?user.id=76669597ccb648f3a43d97e4bc8fbea8&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 259 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:30.353118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 50/97] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:29 2022] GET /identity/v3/role_assignments?user.id=2e97a0404fba471486325b37a982a862&scope.project.id=529a6c2a98614f1ba403d29f1b7423bd&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 259 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:31.647278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b22ce-14d4-4309-8a37-aeb28650b344 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:31.647820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b22ce-14d4-4309-8a37-aeb28650b344 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:31.648084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b22ce-14d4-4309-8a37-aeb28650b344 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:31.649815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 48/98] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:31.656043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e315fe-855c-418c-9e83-821843d62ca1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:31.656550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e315fe-855c-418c-9e83-821843d62ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:31.656650 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e315fe-855c-418c-9e83-821843d62ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:31.685510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b5e315fe-855c-418c-9e83-821843d62ca1 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:31.686985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b5e315fe-855c-418c-9e83-821843d62ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:31.690637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4029d3-8377-4954-9915-dd117c55a6d7 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:31.690981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4029d3-8377-4954-9915-dd117c55a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:31.691319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4029d3-8377-4954-9915-dd117c55a6d7 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:31.692862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 49/99] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:31.705413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f03b69-f265-4918-a1c3-718b7b19be6f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:31.705808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f03b69-f265-4918-a1c3-718b7b19be6f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:31.706153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f03b69-f265-4918-a1c3-718b7b19be6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:31.733292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c6f03b69-f265-4918-a1c3-718b7b19be6f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:31.734620 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c6f03b69-f265-4918-a1c3-718b7b19be6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:31.781946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:31.826346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 51/100] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:31.887136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 50/101] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:32.204447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e315fe-855c-418c-9e83-821843d62ca1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:32.361079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e315fe-855c-418c-9e83-821843d62ca1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:32.403248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74db3c7-99d2-4ef6-9ce0-041cbd760b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:32.404315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74db3c7-99d2-4ef6-9ce0-041cbd760b3c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:32.404914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74db3c7-99d2-4ef6-9ce0-041cbd760b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:32.405417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74db3c7-99d2-4ef6-9ce0-041cbd760b3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:32.419465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74db3c7-99d2-4ef6-9ce0-041cbd760b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a74db3c7-99d2-4ef6-9ce0-041cbd760b3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:32.426380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:32.427234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:32.427989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:32.430263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 52/102] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:54:32.437479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f03b69-f265-4918-a1c3-718b7b19be6f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:32.509368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74db3c7-99d2-4ef6-9ce0-041cbd760b3c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:32.569316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:32.646733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f03b69-f265-4918-a1c3-718b7b19be6f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:32.677565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:32.706428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74db3c7-99d2-4ef6-9ce0-041cbd760b3c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:32.724615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdea72-1cf7-44de-bda8-6859d55e6ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:32.725487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdea72-1cf7-44de-bda8-6859d55e6ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:32.726686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdea72-1cf7-44de-bda8-6859d55e6ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:32.727132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdea72-1cf7-44de-bda8-6859d55e6ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:32.728275 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdea72-1cf7-44de-bda8-6859d55e6ed4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:32.730102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdea72-1cf7-44de-bda8-6859d55e6ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:32.731664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdea72-1cf7-44de-bda8-6859d55e6ed4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:32.748867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 51/103] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:32.750560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4214cca-8a6d-4594-8593-d36d2841f35c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:32.752282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4214cca-8a6d-4594-8593-d36d2841f35c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:32.752794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4214cca-8a6d-4594-8593-d36d2841f35c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:32.755074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 52/104] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:32.756039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4214cca-8a6d-4594-8593-d36d2841f35c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:32.774094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3721f-8003-4145-a739-0d6804c7f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:32.775178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3721f-8003-4145-a739-0d6804c7f205 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:32.775684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3721f-8003-4145-a739-0d6804c7f205 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:32.776112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3721f-8003-4145-a739-0d6804c7f205 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:32.778684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3721f-8003-4145-a739-0d6804c7f205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:32.780520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3721f-8003-4145-a739-0d6804c7f205 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:32.783562 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 53/105] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:32.787369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949369c-55fb-46e8-97cc-ce6fa5c6614f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:32.787842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949369c-55fb-46e8-97cc-ce6fa5c6614f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:32.790071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949369c-55fb-46e8-97cc-ce6fa5c6614f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:32.819728 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0949369c-55fb-46e8-97cc-ce6fa5c6614f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:32.822443 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0949369c-55fb-46e8-97cc-ce6fa5c6614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:32.955767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 54/106] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:32.956854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949369c-55fb-46e8-97cc-ce6fa5c6614f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:32.985328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4214cca-8a6d-4594-8593-d36d2841f35c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:33.023822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:33.058738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879aff7-8fab-4c43-a647-bef03681d299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:33.059396 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879aff7-8fab-4c43-a647-bef03681d299 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:33.059683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879aff7-8fab-4c43-a647-bef03681d299 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:33.059964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879aff7-8fab-4c43-a647-bef03681d299 None admin] PATH_INFO: `/v3/users/ac0e8deb58574d96afb0e4d8fa2695c8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:33.084121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879aff7-8fab-4c43-a647-bef03681d299 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0e8deb58574d96afb0e4d8fa2695c8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:33.086605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879aff7-8fab-4c43-a647-bef03681d299 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:33.089142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 53/107] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:32 2022] GET /identity/v3/users/ac0e8deb58574d96afb0e4d8fa2695c8 => generated 289 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:33.099516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879aff7-8fab-4c43-a647-bef03681d299 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:33.168171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949369c-55fb-46e8-97cc-ce6fa5c6614f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:33.186999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:33.230312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a13d-3461-48f3-bfbf-f690b4d05339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:33.231012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a13d-3461-48f3-bfbf-f690b4d05339 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:33.231418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a13d-3461-48f3-bfbf-f690b4d05339 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:33.231706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a13d-3461-48f3-bfbf-f690b4d05339 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:33.232405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948a13d-3461-48f3-bfbf-f690b4d05339 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:33.235124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948a13d-3461-48f3-bfbf-f690b4d05339 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:33.270484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879aff7-8fab-4c43-a647-bef03681d299 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:33.274116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 55/108] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:54:32 2022] POST /identity/v3/projects => generated 302 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:33.275892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271780e-d234-4b7f-8afe-35a82f43e97c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:33.276360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271780e-d234-4b7f-8afe-35a82f43e97c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:33.276695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271780e-d234-4b7f-8afe-35a82f43e97c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:33.278587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 56/109] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:33.281693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580bfb-ba74-4c73-9ee9-387cbf8154b1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:33.282009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580bfb-ba74-4c73-9ee9-387cbf8154b1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:33.282259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580bfb-ba74-4c73-9ee9-387cbf8154b1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:33.284794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 57/110] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:33.284794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580bfb-ba74-4c73-9ee9-387cbf8154b1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:33.328297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1c0a9-574e-4da2-bf5c-dd56b1377165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:33.328974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1c0a9-574e-4da2-bf5c-dd56b1377165 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:33.329263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1c0a9-574e-4da2-bf5c-dd56b1377165 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:33.329543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1c0a9-574e-4da2-bf5c-dd56b1377165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:33.418300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:33.432911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1c0a9-574e-4da2-bf5c-dd56b1377165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:33.434903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1c0a9-574e-4da2-bf5c-dd56b1377165 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:33.448305 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580bfb-ba74-4c73-9ee9-387cbf8154b1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:33.481370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:33.495346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3e87-98a4-4302-b3f9-20b773bb008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:33.496008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3e87-98a4-4302-b3f9-20b773bb008f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:33.496309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3e87-98a4-4302-b3f9-20b773bb008f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:33.496614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3e87-98a4-4302-b3f9-20b773bb008f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:33.509782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3e87-98a4-4302-b3f9-20b773bb008f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-76ac3e87-98a4-4302-b3f9-20b773bb008f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:33.514681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:33.516139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 58/111] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:33.517696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01c37-e976-4125-8ae4-0fbd8380e5d5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:33.519049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01c37-e976-4125-8ae4-0fbd8380e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:33.519049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01c37-e976-4125-8ae4-0fbd8380e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:33.548643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-05c01c37-e976-4125-8ae4-0fbd8380e5d5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:33.549933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-05c01c37-e976-4125-8ae4-0fbd8380e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:33.616131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 54/112] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:33.619131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6cc83-aa7a-4289-b1f1-7be97af49c2e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:33.619703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6cc83-aa7a-4289-b1f1-7be97af49c2e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:33.620178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6cc83-aa7a-4289-b1f1-7be97af49c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:33.641045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a5b6cc83-aa7a-4289-b1f1-7be97af49c2e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:33.642694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a5b6cc83-aa7a-4289-b1f1-7be97af49c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:33.659233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 59/113] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:33.660654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01c37-e976-4125-8ae4-0fbd8380e5d5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:33.738353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 55/114] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:33.745789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6cc83-aa7a-4289-b1f1-7be97af49c2e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:33.755665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:33.813006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01c37-e976-4125-8ae4-0fbd8380e5d5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:33.884979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1d7bb-ba5b-4229-8c9f-cea3eb1c9a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:33.885991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1d7bb-ba5b-4229-8c9f-cea3eb1c9a97 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:33.886471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1d7bb-ba5b-4229-8c9f-cea3eb1c9a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:33.886960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1d7bb-ba5b-4229-8c9f-cea3eb1c9a97 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:33.887896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1d7bb-ba5b-4229-8c9f-cea3eb1c9a97 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:33.888447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1d7bb-ba5b-4229-8c9f-cea3eb1c9a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:33.890039 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1d7bb-ba5b-4229-8c9f-cea3eb1c9a97 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:33.900786 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:33.910284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 60/115] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:33.913084 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3516c8-b811-4a54-9f7e-54f839f9ef82 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:33.913389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3516c8-b811-4a54-9f7e-54f839f9ef82 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:33.913674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3516c8-b811-4a54-9f7e-54f839f9ef82 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:33.915522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 61/116] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:33.916258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3516c8-b811-4a54-9f7e-54f839f9ef82 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:33.977067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6cc83-aa7a-4289-b1f1-7be97af49c2e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:34.026617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0b798-b20f-432b-9572-37a951b341e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:34.027245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0b798-b20f-432b-9572-37a951b341e0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.027537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0b798-b20f-432b-9572-37a951b341e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.027818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0b798-b20f-432b-9572-37a951b341e0 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.029652 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0b798-b20f-432b-9572-37a951b341e0 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:34.031591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0b798-b20f-432b-9572-37a951b341e0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:34.034144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 56/117] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:33 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:34.035783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287f806-a643-4517-a33e-2379bb06bea9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.036086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287f806-a643-4517-a33e-2379bb06bea9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.036393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287f806-a643-4517-a33e-2379bb06bea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.057800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3516c8-b811-4a54-9f7e-54f839f9ef82 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:34.059699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a287f806-a643-4517-a33e-2379bb06bea9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:34.061941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a287f806-a643-4517-a33e-2379bb06bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:34.105234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a247a9-3755-4be3-aa56-f437df446860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:34.106247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a247a9-3755-4be3-aa56-f437df446860 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.106642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a247a9-3755-4be3-aa56-f437df446860 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.107068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a247a9-3755-4be3-aa56-f437df446860 None admin] PATH_INFO: `/v3/users/2e97a0404fba471486325b37a982a862` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.108445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a247a9-3755-4be3-aa56-f437df446860 None admin] RBAC: Authorizing `identity:get_user(user_id=2e97a0404fba471486325b37a982a862)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:34.110037 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a247a9-3755-4be3-aa56-f437df446860 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:34.116153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 62/118] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:33 2022] GET /identity/v3/users/2e97a0404fba471486325b37a982a862 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:34.116153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a247a9-3755-4be3-aa56-f437df446860 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:34.136053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:34.165401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 57/119] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:34.165401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287f806-a643-4517-a33e-2379bb06bea9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:34.245844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:34.270764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a247a9-3755-4be3-aa56-f437df446860 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:34.303638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287f806-a643-4517-a33e-2379bb06bea9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:34.307805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047cd2-b841-4f3d-9fbc-6b3afd664ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:34.308480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047cd2-b841-4f3d-9fbc-6b3afd664ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.308764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047cd2-b841-4f3d-9fbc-6b3afd664ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.309043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047cd2-b841-4f3d-9fbc-6b3afd664ad3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.328658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047cd2-b841-4f3d-9fbc-6b3afd664ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-04047cd2-b841-4f3d-9fbc-6b3afd664ad3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:34.335555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:34.336590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:34.338391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:34.340896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 63/120] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:54:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:34.342749 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047cd2-b841-4f3d-9fbc-6b3afd664ad3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:34.362777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c0a46-179d-4adb-a2e3-affabcf648bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:34.363978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c0a46-179d-4adb-a2e3-affabcf648bf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.364610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c0a46-179d-4adb-a2e3-affabcf648bf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.365316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c0a46-179d-4adb-a2e3-affabcf648bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.367008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c0a46-179d-4adb-a2e3-affabcf648bf None admin] RBAC: Adding query filter params (role.id=15e6445cc58a46448b7b3bdff71f24d8, scope.project.id=63e130b98cab47d38aafc327c5475d29, user.id=ac0e8deb58574d96afb0e4d8fa2695c8) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:34.367655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c0a46-179d-4adb-a2e3-affabcf648bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:34.370655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c0a46-179d-4adb-a2e3-affabcf648bf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:34.378879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 58/121] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:34 2022] GET /identity/v3/role_assignments?user.id=ac0e8deb58574d96afb0e4d8fa2695c8&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=15e6445cc58a46448b7b3bdff71f24d8 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:34.379876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c0a46-179d-4adb-a2e3-affabcf648bf None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:34.441387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:34.487605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047cd2-b841-4f3d-9fbc-6b3afd664ad3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:34.515447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c0a46-179d-4adb-a2e3-affabcf648bf None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:34.527763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1e7cd-a4dd-4846-9192-e6348f27ee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:34.528614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e7cd-a4dd-4846-9192-e6348f27ee13 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.528904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e7cd-a4dd-4846-9192-e6348f27ee13 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.529186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e7cd-a4dd-4846-9192-e6348f27ee13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.542498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1e7cd-a4dd-4846-9192-e6348f27ee13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:34.547584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b6b1e7cd-a4dd-4846-9192-e6348f27ee13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:34.549550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:34.550806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 64/122] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:54:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:34.557250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1e7cd-a4dd-4846-9192-e6348f27ee13 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:34.567584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14329-db10-4530-bb44-cc99d1827a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:34.568726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14329-db10-4530-bb44-cc99d1827a69 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.569156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14329-db10-4530-bb44-cc99d1827a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.569719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14329-db10-4530-bb44-cc99d1827a69 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.572528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e14329-db10-4530-bb44-cc99d1827a69 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:34.574434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e14329-db10-4530-bb44-cc99d1827a69 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:34.577071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 59/123] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:34 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:34.578298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14329-db10-4530-bb44-cc99d1827a69 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:34.677346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1e7cd-a4dd-4846-9192-e6348f27ee13 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:34.708138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:34.715375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14329-db10-4530-bb44-cc99d1827a69 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:34.719695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162951b-542e-4a57-92b1-0b5d2d3caaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:34.720627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162951b-542e-4a57-92b1-0b5d2d3caaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.721108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162951b-542e-4a57-92b1-0b5d2d3caaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.721611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162951b-542e-4a57-92b1-0b5d2d3caaf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.722585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162951b-542e-4a57-92b1-0b5d2d3caaf3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:34.723189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162951b-542e-4a57-92b1-0b5d2d3caaf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:34.724849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162951b-542e-4a57-92b1-0b5d2d3caaf3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:34.735675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 65/124] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:54:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:34.736978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162951b-542e-4a57-92b1-0b5d2d3caaf3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:34.753681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad472-02ed-4a79-bcfd-9d4a06f0057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:34.754368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad472-02ed-4a79-bcfd-9d4a06f0057f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.754615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad472-02ed-4a79-bcfd-9d4a06f0057f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.754894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad472-02ed-4a79-bcfd-9d4a06f0057f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.769903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ad472-02ed-4a79-bcfd-9d4a06f0057f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0a8ad472-02ed-4a79-bcfd-9d4a06f0057f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:34.776525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:34.777728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:34.778498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 60/125] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:34.779124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad472-02ed-4a79-bcfd-9d4a06f0057f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:34.846864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:34.885606 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162951b-542e-4a57-92b1-0b5d2d3caaf3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:34.904292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad472-02ed-4a79-bcfd-9d4a06f0057f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:34.938870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9bf7f-77e3-4f0b-9d9e-b35d8e72923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:34.939861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9bf7f-77e3-4f0b-9d9e-b35d8e72923b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.940389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9bf7f-77e3-4f0b-9d9e-b35d8e72923b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.940863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9bf7f-77e3-4f0b-9d9e-b35d8e72923b None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.941723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9bf7f-77e3-4f0b-9d9e-b35d8e72923b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:34.942249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9bf7f-77e3-4f0b-9d9e-b35d8e72923b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:34.943844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9bf7f-77e3-4f0b-9d9e-b35d8e72923b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:34.952370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0276b-ffd0-447d-be03-2182e2f4ece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:34.953192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0276b-ffd0-447d-be03-2182e2f4ece5 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:34.953599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0276b-ffd0-447d-be03-2182e2f4ece5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:34.954050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0276b-ffd0-447d-be03-2182e2f4ece5 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29/users/2e97a0404fba471486325b37a982a862/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:34.954938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 66/126] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:34.959523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0276b-ffd0-447d-be03-2182e2f4ece5 None admin] RBAC: Authorizing `identity:create_grant(project_id=63e130b98cab47d38aafc327c5475d29, user_id=2e97a0404fba471486325b37a982a862, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:34.960275 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0276b-ffd0-447d-be03-2182e2f4ece5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:34.960918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9bf7f-77e3-4f0b-9d9e-b35d8e72923b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:34.986540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 61/127] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:54:34 2022] PUT /identity/v3/projects/63e130b98cab47d38aafc327c5475d29/users/2e97a0404fba471486325b37a982a862/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:54:34.993643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0276b-ffd0-447d-be03-2182e2f4ece5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:35.108271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:35.185540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0276b-ffd0-447d-be03-2182e2f4ece5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:35.212571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:35.217364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9bf7f-77e3-4f0b-9d9e-b35d8e72923b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:35.244863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa46fed-9b14-4f14-a509-5a76c531e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:35.246110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa46fed-9b14-4f14-a509-5a76c531e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.247426 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa46fed-9b14-4f14-a509-5a76c531e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.248456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa46fed-9b14-4f14-a509-5a76c531e5e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.250166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa46fed-9b14-4f14-a509-5a76c531e5e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:35.251495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa46fed-9b14-4f14-a509-5a76c531e5e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:35.255637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa46fed-9b14-4f14-a509-5a76c531e5e4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:35.265913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4212e-e879-4316-b607-4a7da81f21ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:35.266729 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4212e-e879-4316-b607-4a7da81f21ba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.268236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4212e-e879-4316-b607-4a7da81f21ba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.268236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4212e-e879-4316-b607-4a7da81f21ba None admin] PATH_INFO: `/v3/users/2e97a0404fba471486325b37a982a862` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.269141 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4212e-e879-4316-b607-4a7da81f21ba None admin] RBAC: Authorizing `identity:get_user(user_id=2e97a0404fba471486325b37a982a862)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:35.272240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 62/128] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:35.273148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4212e-e879-4316-b607-4a7da81f21ba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:35.274285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa46fed-9b14-4f14-a509-5a76c531e5e4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:35.280690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 67/129] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:34 2022] GET /identity/v3/users/2e97a0404fba471486325b37a982a862 => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:35.282645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4212e-e879-4316-b607-4a7da81f21ba None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:35.454584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4212e-e879-4316-b607-4a7da81f21ba None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:35.475438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:35.498664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7ca90-e34a-4979-8033-4f91998008ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:35.500760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7ca90-e34a-4979-8033-4f91998008ec None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.501387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7ca90-e34a-4979-8033-4f91998008ec None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.503098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7ca90-e34a-4979-8033-4f91998008ec None admin] PATH_INFO: `/v3/users/2e97a0404fba471486325b37a982a862` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.504661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7ca90-e34a-4979-8033-4f91998008ec None admin] RBAC: Authorizing `identity:get_user(user_id=2e97a0404fba471486325b37a982a862)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:35.511202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7ca90-e34a-4979-8033-4f91998008ec None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:35.513180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 68/130] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:35 2022] GET /identity/v3/users/2e97a0404fba471486325b37a982a862 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:35.514119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7ca90-e34a-4979-8033-4f91998008ec None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:35.541534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa46fed-9b14-4f14-a509-5a76c531e5e4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:35.595455 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d5a9-60bc-4920-8524-99dfd494001b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:35.596118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d5a9-60bc-4920-8524-99dfd494001b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.596439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d5a9-60bc-4920-8524-99dfd494001b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.596726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d5a9-60bc-4920-8524-99dfd494001b None admin] PATH_INFO: `/v3/users/76669597ccb648f3a43d97e4bc8fbea8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.597917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d5a9-60bc-4920-8524-99dfd494001b None admin] RBAC: Authorizing `identity:get_user(user_id=76669597ccb648f3a43d97e4bc8fbea8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:35.599416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d5a9-60bc-4920-8524-99dfd494001b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:35.606691 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 63/131] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:35 2022] GET /identity/v3/users/76669597ccb648f3a43d97e4bc8fbea8 => generated 247 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:35.607693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d5a9-60bc-4920-8524-99dfd494001b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:35.650723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7ca90-e34a-4979-8033-4f91998008ec None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:35.668537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:35.706436 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534639-8727-440a-bd5b-39c66881ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:35.707019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534639-8727-440a-bd5b-39c66881ae6e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.707303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534639-8727-440a-bd5b-39c66881ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.707646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534639-8727-440a-bd5b-39c66881ae6e None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.708862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534639-8727-440a-bd5b-39c66881ae6e None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:35.710316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534639-8727-440a-bd5b-39c66881ae6e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:35.713779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 69/132] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:35 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:35.715049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534639-8727-440a-bd5b-39c66881ae6e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:35.741238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d5a9-60bc-4920-8524-99dfd494001b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:35.779445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc483e57-aeaa-49ac-a657-136726ce32d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:35.780936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc483e57-aeaa-49ac-a657-136726ce32d9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.781421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc483e57-aeaa-49ac-a657-136726ce32d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.781912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc483e57-aeaa-49ac-a657-136726ce32d9 None admin] PATH_INFO: `/v3/projects/529a6c2a98614f1ba403d29f1b7423bd` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.783386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc483e57-aeaa-49ac-a657-136726ce32d9 None admin] RBAC: Authorizing `identity:get_project(project_id=529a6c2a98614f1ba403d29f1b7423bd)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:35.783492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:35.785378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc483e57-aeaa-49ac-a657-136726ce32d9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:35.787465 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 64/133] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:35 2022] GET /identity/v3/projects/529a6c2a98614f1ba403d29f1b7423bd => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:35.788893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4595a-0dff-4acb-9eeb-c86fef8a1381 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.789394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4595a-0dff-4acb-9eeb-c86fef8a1381 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.789904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4595a-0dff-4acb-9eeb-c86fef8a1381 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.791395 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 65/134] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:35.792353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4595a-0dff-4acb-9eeb-c86fef8a1381 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:35.837673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534639-8727-440a-bd5b-39c66881ae6e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:35.886380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213225ba-e167-4f17-a87a-a62adae94a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:35.887143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213225ba-e167-4f17-a87a-a62adae94a95 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.887328 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213225ba-e167-4f17-a87a-a62adae94a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.887616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213225ba-e167-4f17-a87a-a62adae94a95 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.888907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213225ba-e167-4f17-a87a-a62adae94a95 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:35.890476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213225ba-e167-4f17-a87a-a62adae94a95 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:35.892166 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 70/135] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:35 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:35.901729 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552fea7-83ff-42ef-930f-e24a0be74b53 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.902269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552fea7-83ff-42ef-930f-e24a0be74b53 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.902761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552fea7-83ff-42ef-930f-e24a0be74b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.908685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4595a-0dff-4acb-9eeb-c86fef8a1381 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:35.925035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:35.929220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a552fea7-83ff-42ef-930f-e24a0be74b53 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:35.931220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a552fea7-83ff-42ef-930f-e24a0be74b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:35.950958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fcd22-6fe3-426a-b6cd-d97fa7e53382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:35.952025 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fcd22-6fe3-426a-b6cd-d97fa7e53382 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.952552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fcd22-6fe3-426a-b6cd-d97fa7e53382 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.953028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fcd22-6fe3-426a-b6cd-d97fa7e53382 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29/users/2e97a0404fba471486325b37a982a862/roles/5923fa436ead4ac4b096b40af8672f94` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.955569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fcd22-6fe3-426a-b6cd-d97fa7e53382 None admin] RBAC: Authorizing `identity:create_grant(project_id=63e130b98cab47d38aafc327c5475d29, user_id=2e97a0404fba471486325b37a982a862, role_id=5923fa436ead4ac4b096b40af8672f94)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:35.957350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fcd22-6fe3-426a-b6cd-d97fa7e53382 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:35.982584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 66/136] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:54:35 2022] PUT /identity/v3/projects/63e130b98cab47d38aafc327c5475d29/users/2e97a0404fba471486325b37a982a862/roles/5923fa436ead4ac4b096b40af8672f94 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:54:35.983763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fcd22-6fe3-426a-b6cd-d97fa7e53382 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:36.036230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 71/137] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:36.036230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552fea7-83ff-42ef-930f-e24a0be74b53 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:36.156023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:36.185903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fcd22-6fe3-426a-b6cd-d97fa7e53382 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:36.231165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552fea7-83ff-42ef-930f-e24a0be74b53 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:36.232184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c882b6d-fb04-4ef7-85ed-137e2edaee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:36.232930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c882b6d-fb04-4ef7-85ed-137e2edaee98 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:36.233222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c882b6d-fb04-4ef7-85ed-137e2edaee98 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:36.233553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c882b6d-fb04-4ef7-85ed-137e2edaee98 None admin] PATH_INFO: `/v3/projects/529a6c2a98614f1ba403d29f1b7423bd/users/2e97a0404fba471486325b37a982a862/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:36.235646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c882b6d-fb04-4ef7-85ed-137e2edaee98 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a6c2a98614f1ba403d29f1b7423bd, user_id=2e97a0404fba471486325b37a982a862, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:36.237161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c882b6d-fb04-4ef7-85ed-137e2edaee98 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:36.261499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 67/138] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:54:35 2022] PUT /identity/v3/projects/529a6c2a98614f1ba403d29f1b7423bd/users/2e97a0404fba471486325b37a982a862/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:54:36.274228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ceb992-4176-4f0d-a81c-d6c73dd7c82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:36.274940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceb992-4176-4f0d-a81c-d6c73dd7c82f None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:36.275225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceb992-4176-4f0d-a81c-d6c73dd7c82f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:36.275503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceb992-4176-4f0d-a81c-d6c73dd7c82f None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29/users/76669597ccb648f3a43d97e4bc8fbea8/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:36.277517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ceb992-4176-4f0d-a81c-d6c73dd7c82f None admin] RBAC: Authorizing `identity:create_grant(project_id=63e130b98cab47d38aafc327c5475d29, user_id=76669597ccb648f3a43d97e4bc8fbea8, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:36.278997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ceb992-4176-4f0d-a81c-d6c73dd7c82f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:36.302182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 72/139] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:54:36 2022] PUT /identity/v3/projects/63e130b98cab47d38aafc327c5475d29/users/76669597ccb648f3a43d97e4bc8fbea8/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:54:36.617218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c882b6d-fb04-4ef7-85ed-137e2edaee98 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:36.623282 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316631-aba6-4747-a0d6-020034e05840 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:36.623590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316631-aba6-4747-a0d6-020034e05840 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:36.623856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316631-aba6-4747-a0d6-020034e05840 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:36.625270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 73/140] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:36.632371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab320b-5ea8-4a89-8b6f-6138a240c286 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:36.632680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab320b-5ea8-4a89-8b6f-6138a240c286 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:36.632964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab320b-5ea8-4a89-8b6f-6138a240c286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:36.656564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-05ab320b-5ea8-4a89-8b6f-6138a240c286 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:36.656748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:36.657696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-05ab320b-5ea8-4a89-8b6f-6138a240c286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:36.738051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 74/141] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:36.774397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c882b6d-fb04-4ef7-85ed-137e2edaee98 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:36.845997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9340737-747f-4630-a291-0cec1ea0eaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:36.846754 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9340737-747f-4630-a291-0cec1ea0eaaa None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:36.846939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9340737-747f-4630-a291-0cec1ea0eaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:36.847221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9340737-747f-4630-a291-0cec1ea0eaaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:36.848401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9340737-747f-4630-a291-0cec1ea0eaaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:36.849891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9340737-747f-4630-a291-0cec1ea0eaaa None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:36.851638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 68/142] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:36.857832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab320b-5ea8-4a89-8b6f-6138a240c286 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:36.924218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:37.010552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab320b-5ea8-4a89-8b6f-6138a240c286 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:37.047412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626ffe3-3b3c-4797-a5f7-1d615202c3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:37.048042 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ffe3-3b3c-4797-a5f7-1d615202c3a0 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:37.048340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ffe3-3b3c-4797-a5f7-1d615202c3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:37.048620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ffe3-3b3c-4797-a5f7-1d615202c3a0 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:37.049290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626ffe3-3b3c-4797-a5f7-1d615202c3a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:37.050763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626ffe3-3b3c-4797-a5f7-1d615202c3a0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:37.080145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 75/143] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:54:36 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:37.118253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9340737-747f-4630-a291-0cec1ea0eaaa None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:37.267671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:37.270488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9340737-747f-4630-a291-0cec1ea0eaaa None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:37.314087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81f14-f373-464c-a748-34d1af8da1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:37.314997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81f14-f373-464c-a748-34d1af8da1dd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:37.315487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81f14-f373-464c-a748-34d1af8da1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:37.315942 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81f14-f373-464c-a748-34d1af8da1dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:37.331442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b81f14-f373-464c-a748-34d1af8da1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-34b81f14-f373-464c-a748-34d1af8da1dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:37.337928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:37.339861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:37.341747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:37.347480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 69/144] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:37.357575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626ffe3-3b3c-4797-a5f7-1d615202c3a0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:37.471345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:37.480652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626ffe3-3b3c-4797-a5f7-1d615202c3a0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:37.528303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc47d0-c80c-4afc-857a-8c53ad41c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:37.528936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc47d0-c80c-4afc-857a-8c53ad41c2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:37.529217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc47d0-c80c-4afc-857a-8c53ad41c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:37.529489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc47d0-c80c-4afc-857a-8c53ad41c2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:37.530170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc47d0-c80c-4afc-857a-8c53ad41c2d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:37.530472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc47d0-c80c-4afc-857a-8c53ad41c2d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:37.531922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc47d0-c80c-4afc-857a-8c53ad41c2d8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:37.541800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 76/145] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:37.547380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81f14-f373-464c-a748-34d1af8da1dd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:37.706825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81f14-f373-464c-a748-34d1af8da1dd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:37.755256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e74cf1-92ba-4d48-bd19-fd57e2f9eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:37.756298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e74cf1-92ba-4d48-bd19-fd57e2f9eee4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:37.756843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e74cf1-92ba-4d48-bd19-fd57e2f9eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:37.757323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e74cf1-92ba-4d48-bd19-fd57e2f9eee4 None admin] PATH_INFO: `/v3/users/ac0e8deb58574d96afb0e4d8fa2695c8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:37.758790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e74cf1-92ba-4d48-bd19-fd57e2f9eee4 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0e8deb58574d96afb0e4d8fa2695c8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:37.761002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e74cf1-92ba-4d48-bd19-fd57e2f9eee4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:37.766496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 70/146] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:37 2022] GET /identity/v3/users/ac0e8deb58574d96afb0e4d8fa2695c8 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:37.769024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc47d0-c80c-4afc-857a-8c53ad41c2d8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:37.935720 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc47d0-c80c-4afc-857a-8c53ad41c2d8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:37.982117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c684749-78f7-4888-9251-c5425a256fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:37.982757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684749-78f7-4888-9251-c5425a256fba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:37.983044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684749-78f7-4888-9251-c5425a256fba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:37.983326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684749-78f7-4888-9251-c5425a256fba None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:37.989122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c684749-78f7-4888-9251-c5425a256fba None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:37.990617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c684749-78f7-4888-9251-c5425a256fba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:37.992364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 77/147] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:37 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:37.999019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e74cf1-92ba-4d48-bd19-fd57e2f9eee4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:38.049007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:38.166727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e74cf1-92ba-4d48-bd19-fd57e2f9eee4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:38.209018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116977d6-5a94-4fdc-aa32-7c8595900bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:38.210021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116977d6-5a94-4fdc-aa32-7c8595900bce None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:38.210509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116977d6-5a94-4fdc-aa32-7c8595900bce None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:38.211007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116977d6-5a94-4fdc-aa32-7c8595900bce None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29/users/ac0e8deb58574d96afb0e4d8fa2695c8/roles/15e6445cc58a46448b7b3bdff71f24d8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:38.213729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116977d6-5a94-4fdc-aa32-7c8595900bce None admin] RBAC: Authorizing `identity:create_grant(project_id=63e130b98cab47d38aafc327c5475d29, user_id=ac0e8deb58574d96afb0e4d8fa2695c8, role_id=15e6445cc58a46448b7b3bdff71f24d8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:38.215447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116977d6-5a94-4fdc-aa32-7c8595900bce None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:38.234571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 71/148] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:54:37 2022] PUT /identity/v3/projects/63e130b98cab47d38aafc327c5475d29/users/ac0e8deb58574d96afb0e4d8fa2695c8/roles/15e6445cc58a46448b7b3bdff71f24d8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:54:38.454330 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc4ff-2734-480c-9f9e-7b6517d911fd None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:38.454747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc4ff-2734-480c-9f9e-7b6517d911fd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:38.454922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc4ff-2734-480c-9f9e-7b6517d911fd None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:38.456290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 78/149] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:38.462806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4169d-77af-412c-9d8f-6138687c3df7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:38.463474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4169d-77af-412c-9d8f-6138687c3df7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:38.463994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4169d-77af-412c-9d8f-6138687c3df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:38.490944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-33c4169d-77af-412c-9d8f-6138687c3df7 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:38.493605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-33c4169d-77af-412c-9d8f-6138687c3df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:38.596280 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 72/150] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:39.146690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cc4ff-2734-480c-9f9e-7b6517d911fd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:39.185660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:39.281212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cc4ff-2734-480c-9f9e-7b6517d911fd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:39.336026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7c7f7-186c-467b-a4fb-aab8e48fccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:39.337431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7c7f7-186c-467b-a4fb-aab8e48fccba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:39.337806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7c7f7-186c-467b-a4fb-aab8e48fccba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:39.338126 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7c7f7-186c-467b-a4fb-aab8e48fccba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:39.359868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7c7f7-186c-467b-a4fb-aab8e48fccba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-83a7c7f7-186c-467b-a4fb-aab8e48fccba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:39.369839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:39.370800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:39.371572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:39.372184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 79/151] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:39.379591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4169d-77af-412c-9d8f-6138687c3df7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:39.452828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:39.582699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4169d-77af-412c-9d8f-6138687c3df7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:39.642540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76939d-a6b9-417e-a668-fffebc1565d8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:39.642862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76939d-a6b9-417e-a668-fffebc1565d8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:39.643103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76939d-a6b9-417e-a668-fffebc1565d8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:39.645875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 80/152] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:39.651622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a23cb-a55b-4ce7-99ce-f3e851a125cf None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:39.651934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a23cb-a55b-4ce7-99ce-f3e851a125cf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:39.652282 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a23cb-a55b-4ce7-99ce-f3e851a125cf None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:39.653775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 81/153] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:39.661790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e52d41-99aa-4ee1-a9c9-9bd91e46931e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:39.662126 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e52d41-99aa-4ee1-a9c9-9bd91e46931e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:39.662340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e52d41-99aa-4ee1-a9c9-9bd91e46931e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:39.692008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3689c1-71aa-4dda-b9c9-05b3244bc672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:39.692691 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3689c1-71aa-4dda-b9c9-05b3244bc672 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:39.692978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3689c1-71aa-4dda-b9c9-05b3244bc672 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:39.693256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3689c1-71aa-4dda-b9c9-05b3244bc672 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:39.693951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3689c1-71aa-4dda-b9c9-05b3244bc672 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:39.694262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3689c1-71aa-4dda-b9c9-05b3244bc672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:39.696096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3689c1-71aa-4dda-b9c9-05b3244bc672 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:39.700020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-39e52d41-99aa-4ee1-a9c9-9bd91e46931e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:39.701556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-39e52d41-99aa-4ee1-a9c9-9bd91e46931e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:39.723622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 73/154] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:39.727957 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ee2cc-1471-40e0-8401-9f28e36ddb3e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:39.728500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ee2cc-1471-40e0-8401-9f28e36ddb3e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:39.728793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ee2cc-1471-40e0-8401-9f28e36ddb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:39.775126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-174ee2cc-1471-40e0-8401-9f28e36ddb3e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:39.777152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-174ee2cc-1471-40e0-8401-9f28e36ddb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:39.867491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 82/155] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:39.868991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e52d41-99aa-4ee1-a9c9-9bd91e46931e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:39.921369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:39.945823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 74/156] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:39.948119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43239c7d-3975-41d1-ad26-4e936ee5fd8b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:39.952800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43239c7d-3975-41d1-ad26-4e936ee5fd8b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:39.953199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43239c7d-3975-41d1-ad26-4e936ee5fd8b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:39.955393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 75/157] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:39.964162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540d32a-b102-4dbd-81f7-d545c00d56ca None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:39.968575 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540d32a-b102-4dbd-81f7-d545c00d56ca None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:39.968893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540d32a-b102-4dbd-81f7-d545c00d56ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:40.029349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8540d32a-b102-4dbd-81f7-d545c00d56ca None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:40.030534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8540d32a-b102-4dbd-81f7-d545c00d56ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:40.038447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:40.116094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e52d41-99aa-4ee1-a9c9-9bd91e46931e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:40.177494 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb224cfe-bfd0-4297-b88b-6d7f5abae89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:40.180135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb224cfe-bfd0-4297-b88b-6d7f5abae89f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:40.181097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb224cfe-bfd0-4297-b88b-6d7f5abae89f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:40.181812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb224cfe-bfd0-4297-b88b-6d7f5abae89f None admin] PATH_INFO: `/v3/users/2e97a0404fba471486325b37a982a862` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:40.183513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb224cfe-bfd0-4297-b88b-6d7f5abae89f None admin] RBAC: Authorizing `identity:get_user(user_id=2e97a0404fba471486325b37a982a862)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:40.185385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb224cfe-bfd0-4297-b88b-6d7f5abae89f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:40.187233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 83/158] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:39 2022] GET /identity/v3/users/2e97a0404fba471486325b37a982a862 => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:40.194527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb224cfe-bfd0-4297-b88b-6d7f5abae89f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:40.316833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:40.322555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 76/159] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:40.336546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb224cfe-bfd0-4297-b88b-6d7f5abae89f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:40.377432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1211e-3c1e-4353-a061-cd2c11594549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:40.378324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1211e-3c1e-4353-a061-cd2c11594549 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:40.378764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1211e-3c1e-4353-a061-cd2c11594549 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:40.379188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1211e-3c1e-4353-a061-cd2c11594549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:40.452677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1211e-3c1e-4353-a061-cd2c11594549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:40.454508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1211e-3c1e-4353-a061-cd2c11594549 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:40.545268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:40.564492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 84/160] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:54:40.567897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540d32a-b102-4dbd-81f7-d545c00d56ca None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:40.684848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1211e-3c1e-4353-a061-cd2c11594549 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:40.734535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540d32a-b102-4dbd-81f7-d545c00d56ca None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:40.798133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2cf85-8df9-4f6f-9966-69b5858e364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:40.799072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cf85-8df9-4f6f-9966-69b5858e364f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:40.799571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cf85-8df9-4f6f-9966-69b5858e364f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:40.799992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cf85-8df9-4f6f-9966-69b5858e364f None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:40.801404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2cf85-8df9-4f6f-9966-69b5858e364f None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:40.803036 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2cf85-8df9-4f6f-9966-69b5858e364f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:40.806230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 77/161] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:40 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:40.812016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2cf85-8df9-4f6f-9966-69b5858e364f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:40.836893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:40.934401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1211e-3c1e-4353-a061-cd2c11594549 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:40.984585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2cf85-8df9-4f6f-9966-69b5858e364f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:41.021830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f153e-79f3-464e-8366-5170bf00e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:41.022715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f153e-79f3-464e-8366-5170bf00e89d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:41.023241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f153e-79f3-464e-8366-5170bf00e89d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:41.023762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f153e-79f3-464e-8366-5170bf00e89d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:41.044131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f153e-79f3-464e-8366-5170bf00e89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:41.054849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d4dfb-87ff-4032-9601-6990b1789b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:41.056806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4dfb-87ff-4032-9601-6990b1789b61 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:41.057529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4dfb-87ff-4032-9601-6990b1789b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:41.057992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4dfb-87ff-4032-9601-6990b1789b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:41.058930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d4dfb-87ff-4032-9601-6990b1789b61 None admin] RBAC: Adding query filter params (role.id=2db61e25a9cb41608fb5c1dd7983e1d9, scope.project.id=63e130b98cab47d38aafc327c5475d29, user.id=2e97a0404fba471486325b37a982a862) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:41.059401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d4dfb-87ff-4032-9601-6990b1789b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:41.061100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d4dfb-87ff-4032-9601-6990b1789b61 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-212f153e-79f3-464e-8366-5170bf00e89d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:41.063963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:41.064852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:41.065620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:41.068668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 85/162] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:41.069900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f153e-79f3-464e-8366-5170bf00e89d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:41.073784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 78/163] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:40 2022] GET /identity/v3/role_assignments?user.id=2e97a0404fba471486325b37a982a862&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:41.076146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d4dfb-87ff-4032-9601-6990b1789b61 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:41.204751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:41.285163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:41.321964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f153e-79f3-464e-8366-5170bf00e89d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:41.366935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d4dfb-87ff-4032-9601-6990b1789b61 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:41.372308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96d7a-b3fc-4ac7-94fd-74b2589b7b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:41.373154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96d7a-b3fc-4ac7-94fd-74b2589b7b2c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:41.373545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96d7a-b3fc-4ac7-94fd-74b2589b7b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:41.374039 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96d7a-b3fc-4ac7-94fd-74b2589b7b2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:41.390549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d96d7a-b3fc-4ac7-94fd-74b2589b7b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-40d96d7a-b3fc-4ac7-94fd-74b2589b7b2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:41.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:41.396782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:41.397561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:41.401178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 86/164] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:54:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:41.402239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96d7a-b3fc-4ac7-94fd-74b2589b7b2c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:41.451786 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e56e1-2fe7-4e67-86d6-f632cc46a953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:41.453048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e56e1-2fe7-4e67-86d6-f632cc46a953 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:41.453623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e56e1-2fe7-4e67-86d6-f632cc46a953 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:41.454119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e56e1-2fe7-4e67-86d6-f632cc46a953 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:41.491650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e56e1-2fe7-4e67-86d6-f632cc46a953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-bf1e56e1-2fe7-4e67-86d6-f632cc46a953 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:41.498239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:41.499205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:41.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:41.502419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 79/165] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:54:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:41.509163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e56e1-2fe7-4e67-86d6-f632cc46a953 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:41.588005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96d7a-b3fc-4ac7-94fd-74b2589b7b2c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:41.602884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:41.676930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cb23f-3861-49b7-874b-5f029ab350b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:41.677493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cb23f-3861-49b7-874b-5f029ab350b7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:41.677784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cb23f-3861-49b7-874b-5f029ab350b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:41.678054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cb23f-3861-49b7-874b-5f029ab350b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:41.678929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cb23f-3861-49b7-874b-5f029ab350b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:41.679241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cb23f-3861-49b7-874b-5f029ab350b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:41.680765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cb23f-3861-49b7-874b-5f029ab350b7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:41.699967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 87/166] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:41.701143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cb23f-3861-49b7-874b-5f029ab350b7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:41.732569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e56e1-2fe7-4e67-86d6-f632cc46a953 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:41.802079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:41.813837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0676f5-7417-4fc5-816a-6cb11f443e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:41.814484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0676f5-7417-4fc5-816a-6cb11f443e92 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:41.814770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0676f5-7417-4fc5-816a-6cb11f443e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:41.815051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0676f5-7417-4fc5-816a-6cb11f443e92 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:41.815748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0676f5-7417-4fc5-816a-6cb11f443e92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:41.816058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0676f5-7417-4fc5-816a-6cb11f443e92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:41.817505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0676f5-7417-4fc5-816a-6cb11f443e92 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:41.842211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 80/167] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:54:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:41.843718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0676f5-7417-4fc5-816a-6cb11f443e92 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:41.915473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cb23f-3861-49b7-874b-5f029ab350b7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:41.993052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f9809-3310-4b62-a1b2-1b26f8ea2fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:41.993922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f9809-3310-4b62-a1b2-1b26f8ea2fce None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:41.994256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f9809-3310-4b62-a1b2-1b26f8ea2fce None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:41.994543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f9809-3310-4b62-a1b2-1b26f8ea2fce None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:41.995237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f9809-3310-4b62-a1b2-1b26f8ea2fce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:41.995617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f9809-3310-4b62-a1b2-1b26f8ea2fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:41.997051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f9809-3310-4b62-a1b2-1b26f8ea2fce None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:42.009561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0676f5-7417-4fc5-816a-6cb11f443e92 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:42.012970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 88/168] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:42.013839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f9809-3310-4b62-a1b2-1b26f8ea2fce None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:42.046837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a1e27-7c12-4197-80a3-dc8b53115c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:42.047504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a1e27-7c12-4197-80a3-dc8b53115c80 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.047787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a1e27-7c12-4197-80a3-dc8b53115c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.048065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a1e27-7c12-4197-80a3-dc8b53115c80 None admin] PATH_INFO: `/v3/users/2e97a0404fba471486325b37a982a862` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.049334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a1e27-7c12-4197-80a3-dc8b53115c80 None admin] RBAC: Authorizing `identity:get_user(user_id=2e97a0404fba471486325b37a982a862)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:42.050871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a1e27-7c12-4197-80a3-dc8b53115c80 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:42.052592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 81/169] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:41 2022] GET /identity/v3/users/2e97a0404fba471486325b37a982a862 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:42.053153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:42.053823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3847-e722-41c3-864d-508d0d99ef2d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.054112 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3847-e722-41c3-864d-508d0d99ef2d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.054451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3847-e722-41c3-864d-508d0d99ef2d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.055922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 82/170] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:42.057338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717f2a-2008-4eba-8431-b4febb83131f None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.057679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717f2a-2008-4eba-8431-b4febb83131f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.057961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717f2a-2008-4eba-8431-b4febb83131f None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.059252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 83/171] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:42.059955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a717f2a-2008-4eba-8431-b4febb83131f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:42.141810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:42.163049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f9809-3310-4b62-a1b2-1b26f8ea2fce None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:42.190859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a717f2a-2008-4eba-8431-b4febb83131f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:42.201439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c609e-3798-4ffa-a0e9-a32ab3bec45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:42.202371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c609e-3798-4ffa-a0e9-a32ab3bec45d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.202819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c609e-3798-4ffa-a0e9-a32ab3bec45d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.203310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c609e-3798-4ffa-a0e9-a32ab3bec45d None admin] PATH_INFO: `/v3/users/2e97a0404fba471486325b37a982a862` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.204701 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c609e-3798-4ffa-a0e9-a32ab3bec45d None admin] RBAC: Authorizing `identity:get_user(user_id=2e97a0404fba471486325b37a982a862)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:42.206343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c609e-3798-4ffa-a0e9-a32ab3bec45d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:42.208657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 89/172] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:42 2022] GET /identity/v3/users/2e97a0404fba471486325b37a982a862 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:42.210042 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2b1e2-262c-4387-9306-5fc15fdbfc3c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.210476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2b1e2-262c-4387-9306-5fc15fdbfc3c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.210896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2b1e2-262c-4387-9306-5fc15fdbfc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.234838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1bf2b1e2-262c-4387-9306-5fc15fdbfc3c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:42.235753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390de28e-a4c5-48e6-b1f7-f0130341308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:42.236445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390de28e-a4c5-48e6-b1f7-f0130341308e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.236732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390de28e-a4c5-48e6-b1f7-f0130341308e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.236973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1bf2b1e2-262c-4387-9306-5fc15fdbfc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:42.237090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390de28e-a4c5-48e6-b1f7-f0130341308e None admin] PATH_INFO: `/v3/users/76669597ccb648f3a43d97e4bc8fbea8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.238179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390de28e-a4c5-48e6-b1f7-f0130341308e None admin] RBAC: Authorizing `identity:get_user(user_id=76669597ccb648f3a43d97e4bc8fbea8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:42.239771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390de28e-a4c5-48e6-b1f7-f0130341308e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:42.241829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 84/173] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:42 2022] GET /identity/v3/users/76669597ccb648f3a43d97e4bc8fbea8 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:42.246359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390de28e-a4c5-48e6-b1f7-f0130341308e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:42.337897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 90/174] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:42.337897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0b79-8fc9-447d-a65e-a26802fc205d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.337897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0b79-8fc9-447d-a65e-a26802fc205d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.337897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0b79-8fc9-447d-a65e-a26802fc205d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.361426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1c6d0b79-8fc9-447d-a65e-a26802fc205d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:42.362814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1c6d0b79-8fc9-447d-a65e-a26802fc205d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:42.412707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:42.417062 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390de28e-a4c5-48e6-b1f7-f0130341308e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:42.452629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:42.459862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2268424-3b50-4b9c-906b-0c4b58fa32aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:42.460959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2268424-3b50-4b9c-906b-0c4b58fa32aa None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.461455 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2268424-3b50-4b9c-906b-0c4b58fa32aa None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.462466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2268424-3b50-4b9c-906b-0c4b58fa32aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.473013 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 91/175] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:42.473649 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0b79-8fc9-447d-a65e-a26802fc205d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:42.577006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2268424-3b50-4b9c-906b-0c4b58fa32aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:42.578907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2268424-3b50-4b9c-906b-0c4b58fa32aa None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:42.644612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0b79-8fc9-447d-a65e-a26802fc205d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:42.688567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1f7b-29f8-402b-b19d-f5ea2e59de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:42.689231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1f7b-29f8-402b-b19d-f5ea2e59de2b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.689589 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1f7b-29f8-402b-b19d-f5ea2e59de2b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.689872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1f7b-29f8-402b-b19d-f5ea2e59de2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.693410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 85/176] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:42.694416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2268424-3b50-4b9c-906b-0c4b58fa32aa None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:42.726405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:42.729213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:42.782919 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a1f7b-29f8-402b-b19d-f5ea2e59de2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:42.784680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a1f7b-29f8-402b-b19d-f5ea2e59de2b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:42.806227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2268424-3b50-4b9c-906b-0c4b58fa32aa None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:42.843490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af492f-e91b-4e8d-b2e2-6418c054f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:42.844399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af492f-e91b-4e8d-b2e2-6418c054f360 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.844864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af492f-e91b-4e8d-b2e2-6418c054f360 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.845313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af492f-e91b-4e8d-b2e2-6418c054f360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.894222 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 92/177] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:42.895502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd5ffd-373d-4f78-9ccf-7314b9068f6a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.895790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd5ffd-373d-4f78-9ccf-7314b9068f6a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.896065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd5ffd-373d-4f78-9ccf-7314b9068f6a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.897473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 93/178] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:42.898347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab5764-1f02-4619-94b4-3b9eba57d370 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:42.898664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab5764-1f02-4619-94b4-3b9eba57d370 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:42.898887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab5764-1f02-4619-94b4-3b9eba57d370 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:42.901246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 94/179] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:42.902006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab5764-1f02-4619-94b4-3b9eba57d370 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:42.928751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af492f-e91b-4e8d-b2e2-6418c054f360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:42.930326 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af492f-e91b-4e8d-b2e2-6418c054f360 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:42.972487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:42.972857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:43.020182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab5764-1f02-4619-94b4-3b9eba57d370 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:43.051987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 86/180] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:43.053101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af492f-e91b-4e8d-b2e2-6418c054f360 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:43.059529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906bb7-1e5f-40c2-8aa0-85167f91639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:43.060279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906bb7-1e5f-40c2-8aa0-85167f91639c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.060646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906bb7-1e5f-40c2-8aa0-85167f91639c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.060983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906bb7-1e5f-40c2-8aa0-85167f91639c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.072480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906bb7-1e5f-40c2-8aa0-85167f91639c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-de906bb7-1e5f-40c2-8aa0-85167f91639c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:43.077426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:43.078336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:43.079133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 95/181] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:54:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:43.079785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906bb7-1e5f-40c2-8aa0-85167f91639c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:43.174434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af492f-e91b-4e8d-b2e2-6418c054f360 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:43.197568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906bb7-1e5f-40c2-8aa0-85167f91639c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:43.207413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:43.214709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cca8a-04d8-49aa-a628-cf9d71fa4ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:43.215360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cca8a-04d8-49aa-a628-cf9d71fa4ffa None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.215645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cca8a-04d8-49aa-a628-cf9d71fa4ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.215924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cca8a-04d8-49aa-a628-cf9d71fa4ffa None admin] PATH_INFO: `/v3/projects/529a6c2a98614f1ba403d29f1b7423bd` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.217755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cca8a-04d8-49aa-a628-cf9d71fa4ffa None admin] RBAC: Authorizing `identity:get_project(project_id=529a6c2a98614f1ba403d29f1b7423bd)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:43.219219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cca8a-04d8-49aa-a628-cf9d71fa4ffa None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:43.220899 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 87/182] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:43 2022] GET /identity/v3/projects/529a6c2a98614f1ba403d29f1b7423bd => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:43.221686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cca8a-04d8-49aa-a628-cf9d71fa4ffa None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:43.225371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:43.263197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d819c-9195-47b0-b670-582de6507575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:43.263850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d819c-9195-47b0-b670-582de6507575 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.264135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d819c-9195-47b0-b670-582de6507575 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.264477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d819c-9195-47b0-b670-582de6507575 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.275781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d819c-9195-47b0-b670-582de6507575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-103d819c-9195-47b0-b670-582de6507575 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:43.280737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:43.281674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:43.282451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 96/183] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:43.283128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cc676-8f07-4bd7-8f26-25dcf0d129f4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.283888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cc676-8f07-4bd7-8f26-25dcf0d129f4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.283888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cc676-8f07-4bd7-8f26-25dcf0d129f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.302687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-070cc676-8f07-4bd7-8f26-25dcf0d129f4 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:43.303982 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-070cc676-8f07-4bd7-8f26-25dcf0d129f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:43.350358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cca8a-04d8-49aa-a628-cf9d71fa4ffa None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:43.387549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d23644-f9a7-44a8-9647-875a5a4a03a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:43.387760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 97/184] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:43.388206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d23644-f9a7-44a8-9647-875a5a4a03a0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.388513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d23644-f9a7-44a8-9647-875a5a4a03a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.388877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758af74-9334-46f6-bd42-8d32453903fb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.388997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d23644-f9a7-44a8-9647-875a5a4a03a0 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.389154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758af74-9334-46f6-bd42-8d32453903fb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.389441 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758af74-9334-46f6-bd42-8d32453903fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.390054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d23644-f9a7-44a8-9647-875a5a4a03a0 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:43.391509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d23644-f9a7-44a8-9647-875a5a4a03a0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:43.393339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 88/185] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:43 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:43.394029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d23644-f9a7-44a8-9647-875a5a4a03a0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:43.421754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8758af74-9334-46f6-bd42-8d32453903fb None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:43.423714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8758af74-9334-46f6-bd42-8d32453903fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:43.496601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:43.530095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 98/186] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:43.531941 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758af74-9334-46f6-bd42-8d32453903fb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:43.552881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d23644-f9a7-44a8-9647-875a5a4a03a0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:43.598763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:43.606188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a830c-ef4c-4a04-8bf6-1ee0b7a973a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:43.607094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a830c-ef4c-4a04-8bf6-1ee0b7a973a2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.607590 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a830c-ef4c-4a04-8bf6-1ee0b7a973a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.608016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a830c-ef4c-4a04-8bf6-1ee0b7a973a2 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.609487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a830c-ef4c-4a04-8bf6-1ee0b7a973a2 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:43.611237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a830c-ef4c-4a04-8bf6-1ee0b7a973a2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:43.613206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 89/187] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:43 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:43.614189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a830c-ef4c-4a04-8bf6-1ee0b7a973a2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:43.689449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758af74-9334-46f6-bd42-8d32453903fb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:43.735304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a830c-ef4c-4a04-8bf6-1ee0b7a973a2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:43.736495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0c6bc-e3fd-45c4-b887-c9832551f287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:43.737125 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0c6bc-e3fd-45c4-b887-c9832551f287 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.737395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0c6bc-e3fd-45c4-b887-c9832551f287 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.737666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0c6bc-e3fd-45c4-b887-c9832551f287 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.738357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0c6bc-e3fd-45c4-b887-c9832551f287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:43.739271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0c6bc-e3fd-45c4-b887-c9832551f287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:43.740005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0c6bc-e3fd-45c4-b887-c9832551f287 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:43.749508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 99/188] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:43.750539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0c6bc-e3fd-45c4-b887-c9832551f287 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:43.784281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484b65b-4c36-47db-a369-54d97d3e69f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:43.785017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b65b-4c36-47db-a369-54d97d3e69f0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.785302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b65b-4c36-47db-a369-54d97d3e69f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.785637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b65b-4c36-47db-a369-54d97d3e69f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.786438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484b65b-4c36-47db-a369-54d97d3e69f0 None admin] RBAC: Adding query filter params (role.id=2db61e25a9cb41608fb5c1dd7983e1d9, scope.project.id=529a6c2a98614f1ba403d29f1b7423bd, user.id=2e97a0404fba471486325b37a982a862) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:43.786766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484b65b-4c36-47db-a369-54d97d3e69f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:43.788385 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484b65b-4c36-47db-a369-54d97d3e69f0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:43.791460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:43.796894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 90/189] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:43 2022] GET /identity/v3/role_assignments?user.id=2e97a0404fba471486325b37a982a862&scope.project.id=529a6c2a98614f1ba403d29f1b7423bd&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:43.797366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484b65b-4c36-47db-a369-54d97d3e69f0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:43.893209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:43.897466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0c6bc-e3fd-45c4-b887-c9832551f287 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:43.934655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484b65b-4c36-47db-a369-54d97d3e69f0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:43.944898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aba3d4-716f-452c-86b1-1ac16100126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:43.945534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aba3d4-716f-452c-86b1-1ac16100126c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.945818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aba3d4-716f-452c-86b1-1ac16100126c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.946687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aba3d4-716f-452c-86b1-1ac16100126c None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.948032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aba3d4-716f-452c-86b1-1ac16100126c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:43.948032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aba3d4-716f-452c-86b1-1ac16100126c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:43.949319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aba3d4-716f-452c-86b1-1ac16100126c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:43.960392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 100/190] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:43.961197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aba3d4-716f-452c-86b1-1ac16100126c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:43.984868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae62b3-71eb-45d5-aae2-25e676a738fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:43.985778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae62b3-71eb-45d5-aae2-25e676a738fe None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:43.986061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae62b3-71eb-45d5-aae2-25e676a738fe None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:43.986342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae62b3-71eb-45d5-aae2-25e676a738fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:43.987083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae62b3-71eb-45d5-aae2-25e676a738fe None admin] RBAC: Adding query filter params (role.id=5923fa436ead4ac4b096b40af8672f94, scope.project.id=63e130b98cab47d38aafc327c5475d29, user.id=2e97a0404fba471486325b37a982a862) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:43.987390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae62b3-71eb-45d5-aae2-25e676a738fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:43.988918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae62b3-71eb-45d5-aae2-25e676a738fe None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:44.001223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 91/191] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:43 2022] GET /identity/v3/role_assignments?user.id=2e97a0404fba471486325b37a982a862&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=5923fa436ead4ac4b096b40af8672f94 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:44.002690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae62b3-71eb-45d5-aae2-25e676a738fe None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:44.102071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:44.139260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aba3d4-716f-452c-86b1-1ac16100126c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:44.159640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae62b3-71eb-45d5-aae2-25e676a738fe None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:44.191324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a58d-e21c-4d26-9637-9cf415ba987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:44.192158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a58d-e21c-4d26-9637-9cf415ba987a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:44.193221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a58d-e21c-4d26-9637-9cf415ba987a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:44.193221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a58d-e21c-4d26-9637-9cf415ba987a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:44.193948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2a58d-e21c-4d26-9637-9cf415ba987a None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=63e130b98cab47d38aafc327c5475d29, user.id=76669597ccb648f3a43d97e4bc8fbea8) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:44.194724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2a58d-e21c-4d26-9637-9cf415ba987a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:44.195801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2a58d-e21c-4d26-9637-9cf415ba987a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:44.205690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 101/192] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:43 2022] GET /identity/v3/role_assignments?user.id=76669597ccb648f3a43d97e4bc8fbea8&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:44.206635 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a58d-e21c-4d26-9637-9cf415ba987a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:44.214121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e5204-e109-4e01-94df-e38be999ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:44.214784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e5204-e109-4e01-94df-e38be999ab33 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:44.215069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e5204-e109-4e01-94df-e38be999ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:44.215340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e5204-e109-4e01-94df-e38be999ab33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:44.217770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e5204-e109-4e01-94df-e38be999ab33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:44.220481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e5204-e109-4e01-94df-e38be999ab33 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:44.226622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 92/193] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:44.226622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e5204-e109-4e01-94df-e38be999ab33 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:44.252172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:44.355605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a58d-e21c-4d26-9637-9cf415ba987a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:44.384571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e5204-e109-4e01-94df-e38be999ab33 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:44.407582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38d691-fca8-40a9-987b-9e342fb24c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:44.408832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38d691-fca8-40a9-987b-9e342fb24c5d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:44.409148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38d691-fca8-40a9-987b-9e342fb24c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:44.409492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38d691-fca8-40a9-987b-9e342fb24c5d None admin] PATH_INFO: `/v3/users/d5d6828b32dd477ca9a276bc3a27bf46` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:44.428009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38d691-fca8-40a9-987b-9e342fb24c5d None admin] RBAC: Authorizing `identity:get_user(user_id=d5d6828b32dd477ca9a276bc3a27bf46)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:44.429781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:44.430227 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38d691-fca8-40a9-987b-9e342fb24c5d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:44.439278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 102/194] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:44 2022] GET /identity/v3/users/d5d6828b32dd477ca9a276bc3a27bf46 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:44.439278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38d691-fca8-40a9-987b-9e342fb24c5d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:44.445100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c24b1-296d-4aed-81d8-f13b7231e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:44.445768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c24b1-296d-4aed-81d8-f13b7231e433 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:44.446685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c24b1-296d-4aed-81d8-f13b7231e433 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:44.446956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c24b1-296d-4aed-81d8-f13b7231e433 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:44.460816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c24b1-296d-4aed-81d8-f13b7231e433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-937c24b1-296d-4aed-81d8-f13b7231e433 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:44.463827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:44.464774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:44.465576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 93/195] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:54:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:44.469211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c24b1-296d-4aed-81d8-f13b7231e433 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:44.536993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:44.553503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38d691-fca8-40a9-987b-9e342fb24c5d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:44.581997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c24b1-296d-4aed-81d8-f13b7231e433 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:44.600225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829b5dd-85da-45e7-9e87-d96984e3366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:44.600892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829b5dd-85da-45e7-9e87-d96984e3366b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:44.601173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829b5dd-85da-45e7-9e87-d96984e3366b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:44.601440 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829b5dd-85da-45e7-9e87-d96984e3366b None admin] PATH_INFO: `/v3/users/ac0e8deb58574d96afb0e4d8fa2695c8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:44.602576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829b5dd-85da-45e7-9e87-d96984e3366b None admin] RBAC: Authorizing `identity:get_user(user_id=ac0e8deb58574d96afb0e4d8fa2695c8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:44.604020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829b5dd-85da-45e7-9e87-d96984e3366b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:44.605955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 103/196] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:44 2022] GET /identity/v3/users/ac0e8deb58574d96afb0e4d8fa2695c8 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:44.606653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829b5dd-85da-45e7-9e87-d96984e3366b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:44.637585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87620f52-2900-4da6-ae8c-02e8201bd93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:44.638361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87620f52-2900-4da6-ae8c-02e8201bd93a None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:44.638883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87620f52-2900-4da6-ae8c-02e8201bd93a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:44.639167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87620f52-2900-4da6-ae8c-02e8201bd93a None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:44.639839 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87620f52-2900-4da6-ae8c-02e8201bd93a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:44.641326 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87620f52-2900-4da6-ae8c-02e8201bd93a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:44.666061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 94/197] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:54:44 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:44.666926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87620f52-2900-4da6-ae8c-02e8201bd93a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:44.739179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:44.752765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829b5dd-85da-45e7-9e87-d96984e3366b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:44.794221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228ad9c-d0db-483e-9971-728df3e4c225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:44.794859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228ad9c-d0db-483e-9971-728df3e4c225 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:44.795142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228ad9c-d0db-483e-9971-728df3e4c225 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:44.795417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228ad9c-d0db-483e-9971-728df3e4c225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:44.828471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87620f52-2900-4da6-ae8c-02e8201bd93a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:44.833478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:44.875378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd490459-b54b-428d-ab40-fb6d70d0caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:44.876419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490459-b54b-428d-ab40-fb6d70d0caa7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:44.876419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490459-b54b-428d-ab40-fb6d70d0caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:44.876613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490459-b54b-428d-ab40-fb6d70d0caa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:44.877283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd490459-b54b-428d-ab40-fb6d70d0caa7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:44.877594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd490459-b54b-428d-ab40-fb6d70d0caa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:44.879087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd490459-b54b-428d-ab40-fb6d70d0caa7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:44.889719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 95/198] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:54:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:44.890785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd490459-b54b-428d-ab40-fb6d70d0caa7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:44.895420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228ad9c-d0db-483e-9971-728df3e4c225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:44.897346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228ad9c-d0db-483e-9971-728df3e4c225 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:45.053431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 104/199] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:45.054450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228ad9c-d0db-483e-9971-728df3e4c225 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:45.069654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd490459-b54b-428d-ab40-fb6d70d0caa7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:45.087571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:45.132941 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:45.140164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38916f2-0610-4f63-bd98-e4c54d4a7ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:45.141192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38916f2-0610-4f63-bd98-e4c54d4a7ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:45.141684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38916f2-0610-4f63-bd98-e4c54d4a7ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:45.142171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38916f2-0610-4f63-bd98-e4c54d4a7ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:45.195011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228ad9c-d0db-483e-9971-728df3e4c225 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:45.238681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61fbe0-767b-4cdf-b947-3ebf32a77073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:45.239395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61fbe0-767b-4cdf-b947-3ebf32a77073 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:45.239725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61fbe0-767b-4cdf-b947-3ebf32a77073 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:45.240006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61fbe0-767b-4cdf-b947-3ebf32a77073 None admin] PATH_INFO: `/v3/users/d5d6828b32dd477ca9a276bc3a27bf46` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:45.241211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61fbe0-767b-4cdf-b947-3ebf32a77073 None admin] RBAC: Authorizing `identity:get_user(user_id=d5d6828b32dd477ca9a276bc3a27bf46)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:45.242660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61fbe0-767b-4cdf-b947-3ebf32a77073 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:45.245669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 105/200] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:45 2022] GET /identity/v3/users/d5d6828b32dd477ca9a276bc3a27bf46 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:45.246978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61fbe0-767b-4cdf-b947-3ebf32a77073 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:45.270061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38916f2-0610-4f63-bd98-e4c54d4a7ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:45.272387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38916f2-0610-4f63-bd98-e4c54d4a7ab9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:45.373685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61fbe0-767b-4cdf-b947-3ebf32a77073 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:45.396368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:45.397092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 96/201] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:45.399865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38916f2-0610-4f63-bd98-e4c54d4a7ab9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:45.414309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414f29-d7a6-446a-b607-f3d6d714a88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:45.415551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414f29-d7a6-446a-b607-f3d6d714a88d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:45.415898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414f29-d7a6-446a-b607-f3d6d714a88d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:45.416258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414f29-d7a6-446a-b607-f3d6d714a88d None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:45.417412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2414f29-d7a6-446a-b607-f3d6d714a88d None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:45.419169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2414f29-d7a6-446a-b607-f3d6d714a88d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:45.420620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 106/202] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:45 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:45.421447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414f29-d7a6-446a-b607-f3d6d714a88d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:45.428049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:45.535204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38916f2-0610-4f63-bd98-e4c54d4a7ab9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:45.568374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414f29-d7a6-446a-b607-f3d6d714a88d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:45.576135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed504f6-30e5-4219-9d44-87ac242d3e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:45.577102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed504f6-30e5-4219-9d44-87ac242d3e07 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:45.577604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed504f6-30e5-4219-9d44-87ac242d3e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:45.578073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed504f6-30e5-4219-9d44-87ac242d3e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:45.611982 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb802c4a-f55d-4cf3-99c7-9d98319a02a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:45.612682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb802c4a-f55d-4cf3-99c7-9d98319a02a5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:45.612966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb802c4a-f55d-4cf3-99c7-9d98319a02a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:45.613246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb802c4a-f55d-4cf3-99c7-9d98319a02a5 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:45.614546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb802c4a-f55d-4cf3-99c7-9d98319a02a5 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:45.616019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb802c4a-f55d-4cf3-99c7-9d98319a02a5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:45.617973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 107/203] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:45 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:45.618659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb802c4a-f55d-4cf3-99c7-9d98319a02a5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:45.669848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed504f6-30e5-4219-9d44-87ac242d3e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:45.671704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed504f6-30e5-4219-9d44-87ac242d3e07 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:45.682847 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:45.708390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:45.762572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb802c4a-f55d-4cf3-99c7-9d98319a02a5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:45.784347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 97/204] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:45.785743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed504f6-30e5-4219-9d44-87ac242d3e07 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:45.802759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d873d07-c2df-403b-a175-80aba915811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:45.803571 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873d07-c2df-403b-a175-80aba915811f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:45.804110 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873d07-c2df-403b-a175-80aba915811f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:45.804555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873d07-c2df-403b-a175-80aba915811f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:45.805968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d873d07-c2df-403b-a175-80aba915811f None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9, user.id=d5d6828b32dd477ca9a276bc3a27bf46) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:45.806291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d873d07-c2df-403b-a175-80aba915811f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:45.808315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d873d07-c2df-403b-a175-80aba915811f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:45.824373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 108/205] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:45 2022] GET /identity/v3/role_assignments?user.id=d5d6828b32dd477ca9a276bc3a27bf46&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:45.824373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d873d07-c2df-403b-a175-80aba915811f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:45.971223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d873d07-c2df-403b-a175-80aba915811f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:45.999828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:46.016532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed504f6-30e5-4219-9d44-87ac242d3e07 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:46.024551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2729a22-0299-49e5-bedd-642f562df457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:46.024551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2729a22-0299-49e5-bedd-642f562df457 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:46.024551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2729a22-0299-49e5-bedd-642f562df457 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:46.024551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2729a22-0299-49e5-bedd-642f562df457 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:46.025007 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2729a22-0299-49e5-bedd-642f562df457 None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:46.025007 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2729a22-0299-49e5-bedd-642f562df457 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:46.026063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 109/206] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:45 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:46.032187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2729a22-0299-49e5-bedd-642f562df457 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:46.043328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:46.110773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfbe53-9932-4aad-8670-17e1daa501ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:46.112659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbe53-9932-4aad-8670-17e1daa501ff None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:46.113632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbe53-9932-4aad-8670-17e1daa501ff None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:46.114186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbe53-9932-4aad-8670-17e1daa501ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:46.116813 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfbe53-9932-4aad-8670-17e1daa501ff None admin] RBAC: Adding query filter params (role.id=15e6445cc58a46448b7b3bdff71f24d8, scope.project.id=63e130b98cab47d38aafc327c5475d29, user.id=ac0e8deb58574d96afb0e4d8fa2695c8) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:46.119048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfbe53-9932-4aad-8670-17e1daa501ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:46.123072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfbe53-9932-4aad-8670-17e1daa501ff None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:46.141043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 98/207] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:45 2022] GET /identity/v3/role_assignments?user.id=ac0e8deb58574d96afb0e4d8fa2695c8&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=15e6445cc58a46448b7b3bdff71f24d8 => generated 608 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:46.210793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2729a22-0299-49e5-bedd-642f562df457 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:46.263988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5c637-deae-4206-bc36-955b4e1b5474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:46.264936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5c637-deae-4206-bc36-955b4e1b5474 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:46.265363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5c637-deae-4206-bc36-955b4e1b5474 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:46.265826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5c637-deae-4206-bc36-955b4e1b5474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:46.267164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5c637-deae-4206-bc36-955b4e1b5474 None admin] RBAC: Adding query filter params (role.id=5923fa436ead4ac4b096b40af8672f94, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9, user.id=d5d6828b32dd477ca9a276bc3a27bf46) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:46.267734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5c637-deae-4206-bc36-955b4e1b5474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:46.270262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5c637-deae-4206-bc36-955b4e1b5474 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:46.281148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 110/208] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:46 2022] GET /identity/v3/role_assignments?user.id=d5d6828b32dd477ca9a276bc3a27bf46&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=5923fa436ead4ac4b096b40af8672f94 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:46.977636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116278b-5148-467e-9411-d36c7db127d1 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:46.978062 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116278b-5148-467e-9411-d36c7db127d1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:46.978612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116278b-5148-467e-9411-d36c7db127d1 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:46.980176 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 99/209] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:46.985770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ec78-933e-4611-8886-029f6f0cd66a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:46.986805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ec78-933e-4611-8886-029f6f0cd66a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:46.987292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ec78-933e-4611-8886-029f6f0cd66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:47.013286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8d26ec78-933e-4611-8886-029f6f0cd66a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:47.014916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8d26ec78-933e-4611-8886-029f6f0cd66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:47.067803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:47.089934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 111/210] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:47.157572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd05e7d-5ca2-46da-99a3-a0148591e986 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:47.158576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd05e7d-5ca2-46da-99a3-a0148591e986 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:47.159058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd05e7d-5ca2-46da-99a3-a0148591e986 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:47.160781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 100/211] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:47.167307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2074ed2-7906-4974-8808-5822b56c938e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:47.167600 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2074ed2-7906-4974-8808-5822b56c938e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:47.167872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2074ed2-7906-4974-8808-5822b56c938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:47.187031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a2074ed2-7906-4974-8808-5822b56c938e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:47.188548 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a2074ed2-7906-4974-8808-5822b56c938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:47.261335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 112/212] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:47.369418 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd05e7d-5ca2-46da-99a3-a0148591e986 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:47.505224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd05e7d-5ca2-46da-99a3-a0148591e986 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:47.536636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2074ed2-7906-4974-8808-5822b56c938e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:47.546121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4f36a-a57e-4245-aab9-ddc5da0afcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:47.546786 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4f36a-a57e-4245-aab9-ddc5da0afcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:47.547071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4f36a-a57e-4245-aab9-ddc5da0afcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:47.547355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4f36a-a57e-4245-aab9-ddc5da0afcb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:47.561179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4f36a-a57e-4245-aab9-ddc5da0afcb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-a9c4f36a-a57e-4245-aab9-ddc5da0afcb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:47.566459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:47.567636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:47.568609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:47.570611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 101/213] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:47.578024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4f36a-a57e-4245-aab9-ddc5da0afcb4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:47.637008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:47.656115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2074ed2-7906-4974-8808-5822b56c938e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:47.671431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:47.694153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcc880-d935-4021-b489-2881be022d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:47.695073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcc880-d935-4021-b489-2881be022d12 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:47.695362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcc880-d935-4021-b489-2881be022d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:47.695656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcc880-d935-4021-b489-2881be022d12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:47.697692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcc880-d935-4021-b489-2881be022d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:47.698948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcc880-d935-4021-b489-2881be022d12 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:47.700722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 113/214] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:47.706621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcc880-d935-4021-b489-2881be022d12 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:47.722384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4f36a-a57e-4245-aab9-ddc5da0afcb4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:47.771636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b1993-61d3-426f-8a55-6197505f5f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:47.772859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1993-61d3-426f-8a55-6197505f5f83 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:47.773401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1993-61d3-426f-8a55-6197505f5f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:47.773876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1993-61d3-426f-8a55-6197505f5f83 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:47.775489 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b1993-61d3-426f-8a55-6197505f5f83 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:47.776119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b1993-61d3-426f-8a55-6197505f5f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:47.778573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b1993-61d3-426f-8a55-6197505f5f83 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:47.794040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 102/215] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:47.801746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b1993-61d3-426f-8a55-6197505f5f83 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:47.843971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcc880-d935-4021-b489-2881be022d12 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:47.900116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391c799-3d57-45d8-b8f4-3ce03e4780a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:47.900880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c799-3d57-45d8-b8f4-3ce03e4780a7 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:47.901167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c799-3d57-45d8-b8f4-3ce03e4780a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:47.901553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c799-3d57-45d8-b8f4-3ce03e4780a7 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:47.902236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391c799-3d57-45d8-b8f4-3ce03e4780a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:47.903710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391c799-3d57-45d8-b8f4-3ce03e4780a7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:47.937453 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:47.944752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b1993-61d3-426f-8a55-6197505f5f83 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:47.952358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 114/216] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:54:47 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:47.996991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acbb6b-1c3e-4183-87d8-060036c4ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:47.998526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acbb6b-1c3e-4183-87d8-060036c4ab94 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:47.999003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acbb6b-1c3e-4183-87d8-060036c4ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:47.999584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acbb6b-1c3e-4183-87d8-060036c4ab94 None admin] PATH_INFO: `/v3/users/4c90d4fcbdda4a1fba569c85280b225d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:48.022280 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acbb6b-1c3e-4183-87d8-060036c4ab94 None admin] RBAC: Authorizing `identity:get_user(user_id=4c90d4fcbdda4a1fba569c85280b225d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:48.023852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acbb6b-1c3e-4183-87d8-060036c4ab94 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:48.026449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 103/217] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:47 2022] GET /identity/v3/users/4c90d4fcbdda4a1fba569c85280b225d => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:48.033898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391c799-3d57-45d8-b8f4-3ce03e4780a7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:48.095017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:48.111777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39fc0-b86f-4b42-90a2-b8b044a1e697 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:48.112071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39fc0-b86f-4b42-90a2-b8b044a1e697 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:48.112554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39fc0-b86f-4b42-90a2-b8b044a1e697 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:48.114526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 104/218] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:48.121708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f6b5b-dcb5-4cde-bd50-c13feca6ad3c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:48.122330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f6b5b-dcb5-4cde-bd50-c13feca6ad3c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:48.122797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f6b5b-dcb5-4cde-bd50-c13feca6ad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:48.151627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-db2f6b5b-dcb5-4cde-bd50-c13feca6ad3c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:48.152939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-db2f6b5b-dcb5-4cde-bd50-c13feca6ad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:48.201131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391c799-3d57-45d8-b8f4-3ce03e4780a7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:48.249184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67125176-ae1c-40e7-a954-20c9edfe20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:48.249812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67125176-ae1c-40e7-a954-20c9edfe20e8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:48.250092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67125176-ae1c-40e7-a954-20c9edfe20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:48.250364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67125176-ae1c-40e7-a954-20c9edfe20e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:48.253343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 105/219] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:48.342508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67125176-ae1c-40e7-a954-20c9edfe20e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:48.344018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67125176-ae1c-40e7-a954-20c9edfe20e8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:48.387851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:48.477873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 115/220] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:48.481120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd5e78-32d5-4fb2-97a1-c3492e9c4757 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:48.481472 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd5e78-32d5-4fb2-97a1-c3492e9c4757 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:48.481770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd5e78-32d5-4fb2-97a1-c3492e9c4757 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:48.483226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 106/221] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:48.485302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67125176-ae1c-40e7-a954-20c9edfe20e8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:48.489154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3285-ce69-4d19-a457-3c158ec5bbad None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:48.489740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3285-ce69-4d19-a457-3c158ec5bbad None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:48.490224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3285-ce69-4d19-a457-3c158ec5bbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:48.510868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c07b3285-ce69-4d19-a457-3c158ec5bbad None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:48.512637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c07b3285-ce69-4d19-a457-3c158ec5bbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:48.602779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67125176-ae1c-40e7-a954-20c9edfe20e8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:48.613531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 107/222] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:48.614618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b3285-ce69-4d19-a457-3c158ec5bbad None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:48.632759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:48.739862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b3285-ce69-4d19-a457-3c158ec5bbad None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:48.765487 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581c38d-20c2-4f9b-8ef0-967fa895711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:48.766762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581c38d-20c2-4f9b-8ef0-967fa895711e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:48.767318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581c38d-20c2-4f9b-8ef0-967fa895711e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:48.767892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581c38d-20c2-4f9b-8ef0-967fa895711e None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:48.772669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581c38d-20c2-4f9b-8ef0-967fa895711e None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:48.775462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581c38d-20c2-4f9b-8ef0-967fa895711e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:48.783098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14f235-bfcd-45e3-ad51-b651ecfde180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:48.784067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14f235-bfcd-45e3-ad51-b651ecfde180 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:48.784658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14f235-bfcd-45e3-ad51-b651ecfde180 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:48.784875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 116/223] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:48 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:48.785286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14f235-bfcd-45e3-ad51-b651ecfde180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:48.791468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581c38d-20c2-4f9b-8ef0-967fa895711e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:48.800200 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14f235-bfcd-45e3-ad51-b651ecfde180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9b14f235-bfcd-45e3-ad51-b651ecfde180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:48.807781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:48.808792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:48.809587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:48.812639 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 108/224] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:48.812937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:48.820231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14f235-bfcd-45e3-ad51-b651ecfde180 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:48.952882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:48.994328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14f235-bfcd-45e3-ad51-b651ecfde180 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:49.034582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581c38d-20c2-4f9b-8ef0-967fa895711e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:49.040577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b217cc8-5190-4c8e-9a63-8265d8d88360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:49.043413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b217cc8-5190-4c8e-9a63-8265d8d88360 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:49.044243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b217cc8-5190-4c8e-9a63-8265d8d88360 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:49.045037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b217cc8-5190-4c8e-9a63-8265d8d88360 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:49.046506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b217cc8-5190-4c8e-9a63-8265d8d88360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:49.047395 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b217cc8-5190-4c8e-9a63-8265d8d88360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:49.051499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b217cc8-5190-4c8e-9a63-8265d8d88360 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:49.066885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 109/225] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:49.067599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b217cc8-5190-4c8e-9a63-8265d8d88360 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:49.097278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87546-f9d0-43a5-bad1-ba1c1d3cb01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:49.098397 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87546-f9d0-43a5-bad1-ba1c1d3cb01c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:49.098887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87546-f9d0-43a5-bad1-ba1c1d3cb01c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:49.099388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87546-f9d0-43a5-bad1-ba1c1d3cb01c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:49.100435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd87546-f9d0-43a5-bad1-ba1c1d3cb01c None admin] RBAC: Adding query filter params (role.id=2db61e25a9cb41608fb5c1dd7983e1d9, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9, user.id=4c90d4fcbdda4a1fba569c85280b225d) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:49.101658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd87546-f9d0-43a5-bad1-ba1c1d3cb01c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:49.104858 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd87546-f9d0-43a5-bad1-ba1c1d3cb01c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:49.113805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 117/226] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:48 2022] GET /identity/v3/role_assignments?user.id=4c90d4fcbdda4a1fba569c85280b225d&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:49.116262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87546-f9d0-43a5-bad1-ba1c1d3cb01c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:49.216315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b217cc8-5190-4c8e-9a63-8265d8d88360 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:49.219023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:49.259095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11edcb-11e9-4b52-88bc-a75ee8c7d481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:49.260108 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11edcb-11e9-4b52-88bc-a75ee8c7d481 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:49.260648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11edcb-11e9-4b52-88bc-a75ee8c7d481 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:49.261160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11edcb-11e9-4b52-88bc-a75ee8c7d481 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:49.269690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87546-f9d0-43a5-bad1-ba1c1d3cb01c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:49.272667 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:49.285339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11edcb-11e9-4b52-88bc-a75ee8c7d481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-fb11edcb-11e9-4b52-88bc-a75ee8c7d481 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:49.298888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:49.299830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:49.301035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:49.309216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 110/227] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:54:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:49.324567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11edcb-11e9-4b52-88bc-a75ee8c7d481 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:49.375684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ce91-085e-4ec1-a845-ca0ab67589aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:49.376998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ce91-085e-4ec1-a845-ca0ab67589aa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:49.376998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ce91-085e-4ec1-a845-ca0ab67589aa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:49.377168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ce91-085e-4ec1-a845-ca0ab67589aa None admin] PATH_INFO: `/v3/users/d5d6828b32dd477ca9a276bc3a27bf46` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:49.378373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ce91-085e-4ec1-a845-ca0ab67589aa None admin] RBAC: Authorizing `identity:get_user(user_id=d5d6828b32dd477ca9a276bc3a27bf46)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:49.379856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ce91-085e-4ec1-a845-ca0ab67589aa None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:49.381523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 118/228] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:49 2022] GET /identity/v3/users/d5d6828b32dd477ca9a276bc3a27bf46 => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:49.388854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ce91-085e-4ec1-a845-ca0ab67589aa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:49.459086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11edcb-11e9-4b52-88bc-a75ee8c7d481 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:49.501078 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab3f5e-5d80-4d1b-a33b-bf5c347b3ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:49.501995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab3f5e-5d80-4d1b-a33b-bf5c347b3ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:49.502341 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab3f5e-5d80-4d1b-a33b-bf5c347b3ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:49.502782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab3f5e-5d80-4d1b-a33b-bf5c347b3ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:49.508981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab3f5e-5d80-4d1b-a33b-bf5c347b3ea3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:49.508981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab3f5e-5d80-4d1b-a33b-bf5c347b3ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:49.508981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab3f5e-5d80-4d1b-a33b-bf5c347b3ea3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:49.522179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 111/229] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:54:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:49.524719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab3f5e-5d80-4d1b-a33b-bf5c347b3ea3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:49.594352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ce91-085e-4ec1-a845-ca0ab67589aa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:49.601361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:49.666528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab3f5e-5d80-4d1b-a33b-bf5c347b3ea3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:49.711709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca1e4-1b46-48f5-9019-5f50e08f98bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:49.712715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca1e4-1b46-48f5-9019-5f50e08f98bd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:49.713199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca1e4-1b46-48f5-9019-5f50e08f98bd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:49.713635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca1e4-1b46-48f5-9019-5f50e08f98bd None admin] PATH_INFO: `/v3/users/d5d6828b32dd477ca9a276bc3a27bf46` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:49.715630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca1e4-1b46-48f5-9019-5f50e08f98bd None admin] RBAC: Authorizing `identity:get_user(user_id=d5d6828b32dd477ca9a276bc3a27bf46)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:49.717964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743fa96-5884-436c-8f2d-5ab5cf1ca615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:49.718599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca1e4-1b46-48f5-9019-5f50e08f98bd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:49.718710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743fa96-5884-436c-8f2d-5ab5cf1ca615 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:49.718890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743fa96-5884-436c-8f2d-5ab5cf1ca615 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:49.719172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743fa96-5884-436c-8f2d-5ab5cf1ca615 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:49.720347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743fa96-5884-436c-8f2d-5ab5cf1ca615 None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:49.721631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 112/230] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:49 2022] GET /identity/v3/users/d5d6828b32dd477ca9a276bc3a27bf46 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:49.721871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743fa96-5884-436c-8f2d-5ab5cf1ca615 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:49.723712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 119/231] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:49 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:49.728995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca1e4-1b46-48f5-9019-5f50e08f98bd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:49.729546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743fa96-5884-436c-8f2d-5ab5cf1ca615 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:49.735966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:49.875239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca1e4-1b46-48f5-9019-5f50e08f98bd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:49.904706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:49.914355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cad678-ba9f-453b-a25d-14c55686d7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:49.915546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cad678-ba9f-453b-a25d-14c55686d7ef None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:49.915898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cad678-ba9f-453b-a25d-14c55686d7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:49.916177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cad678-ba9f-453b-a25d-14c55686d7ef None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:49.917548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cad678-ba9f-453b-a25d-14c55686d7ef None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:49.919101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cad678-ba9f-453b-a25d-14c55686d7ef None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:49.921214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 113/232] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:49 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:49.926956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cad678-ba9f-453b-a25d-14c55686d7ef None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:49.983205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743fa96-5884-436c-8f2d-5ab5cf1ca615 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:50.053207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cad678-ba9f-453b-a25d-14c55686d7ef None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:50.061665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeb6f4-f893-4c2b-9957-f175910184ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:50.062356 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeb6f4-f893-4c2b-9957-f175910184ef None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:50.062638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeb6f4-f893-4c2b-9957-f175910184ef None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:50.062916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeb6f4-f893-4c2b-9957-f175910184ef None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/users/d5d6828b32dd477ca9a276bc3a27bf46/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:50.068517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeb6f4-f893-4c2b-9957-f175910184ef None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4ae55af10f4cf08c544a37c7f275d9, user_id=d5d6828b32dd477ca9a276bc3a27bf46, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:50.070119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeb6f4-f893-4c2b-9957-f175910184ef None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:50.098931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf945ec-c904-4717-851c-d58b00a1a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:50.099667 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf945ec-c904-4717-851c-d58b00a1a06b None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:50.100040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf945ec-c904-4717-851c-d58b00a1a06b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:50.100352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf945ec-c904-4717-851c-d58b00a1a06b None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/users/d5d6828b32dd477ca9a276bc3a27bf46/roles/5923fa436ead4ac4b096b40af8672f94` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:50.104289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf945ec-c904-4717-851c-d58b00a1a06b None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4ae55af10f4cf08c544a37c7f275d9, user_id=d5d6828b32dd477ca9a276bc3a27bf46, role_id=5923fa436ead4ac4b096b40af8672f94)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:50.108878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf945ec-c904-4717-851c-d58b00a1a06b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:50.114850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 120/233] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:54:49 2022] PUT /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/users/d5d6828b32dd477ca9a276bc3a27bf46/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:54:50.138014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 114/234] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:54:49 2022] PUT /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/users/d5d6828b32dd477ca9a276bc3a27bf46/roles/5923fa436ead4ac4b096b40af8672f94 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:54:50.599518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f96861-05f3-4e61-973c-684ed8933506 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:50.600082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f96861-05f3-4e61-973c-684ed8933506 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:50.600563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f96861-05f3-4e61-973c-684ed8933506 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:50.603086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 121/235] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:50.609877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734dd68-6bb1-44dc-84b5-1c0485081d4c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:50.610807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734dd68-6bb1-44dc-84b5-1c0485081d4c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:50.611274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734dd68-6bb1-44dc-84b5-1c0485081d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:50.639619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5734dd68-6bb1-44dc-84b5-1c0485081d4c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:50.642052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5734dd68-6bb1-44dc-84b5-1c0485081d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:50.694162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e354a-775f-4305-a975-331fec1b507a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:50.694426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e354a-775f-4305-a975-331fec1b507a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:50.694720 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e354a-775f-4305-a975-331fec1b507a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:50.696380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 122/236] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:50.704058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebeadf-fe81-493d-b138-710da27e4e5d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:50.704456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebeadf-fe81-493d-b138-710da27e4e5d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:50.704839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebeadf-fe81-493d-b138-710da27e4e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:50.716124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:50.745327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-08ebeadf-fe81-493d-b138-710da27e4e5d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:50.746577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-08ebeadf-fe81-493d-b138-710da27e4e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:50.768540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 115/237] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:50.865008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:50.881719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 123/238] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:51.265297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734dd68-6bb1-44dc-84b5-1c0485081d4c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:51.313995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebeadf-fe81-493d-b138-710da27e4e5d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:51.424795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebeadf-fe81-493d-b138-710da27e4e5d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:51.435381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734dd68-6bb1-44dc-84b5-1c0485081d4c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:51.464833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df162c1b-7d79-4c2a-aa7a-e129e19f2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:51.465852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df162c1b-7d79-4c2a-aa7a-e129e19f2a9a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:51.466429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df162c1b-7d79-4c2a-aa7a-e129e19f2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:51.467176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df162c1b-7d79-4c2a-aa7a-e129e19f2a9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:51.479410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df162c1b-7d79-4c2a-aa7a-e129e19f2a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-df162c1b-7d79-4c2a-aa7a-e129e19f2a9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:51.484712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:51.485595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:51.486389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:51.493704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 124/239] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:54:51.495293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df162c1b-7d79-4c2a-aa7a-e129e19f2a9a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:51.523736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e87028-f68a-43dc-a6e0-094a736510a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:51.525205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e87028-f68a-43dc-a6e0-094a736510a5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:51.525491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e87028-f68a-43dc-a6e0-094a736510a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:51.525769 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e87028-f68a-43dc-a6e0-094a736510a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:51.529244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e87028-f68a-43dc-a6e0-094a736510a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:51.530865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e87028-f68a-43dc-a6e0-094a736510a5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:51.532961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 116/240] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:51.538198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e87028-f68a-43dc-a6e0-094a736510a5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:51.562287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:51.612760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df162c1b-7d79-4c2a-aa7a-e129e19f2a9a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:51.636722 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:51.654230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b442c5-c4e9-456f-9db1-fb4762be710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:51.655205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b442c5-c4e9-456f-9db1-fb4762be710d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:51.655695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b442c5-c4e9-456f-9db1-fb4762be710d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:51.656167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b442c5-c4e9-456f-9db1-fb4762be710d None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:51.657071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b442c5-c4e9-456f-9db1-fb4762be710d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:51.657605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b442c5-c4e9-456f-9db1-fb4762be710d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:51.659205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b442c5-c4e9-456f-9db1-fb4762be710d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:51.669157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 125/241] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:51.675724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b442c5-c4e9-456f-9db1-fb4762be710d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:51.767726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e87028-f68a-43dc-a6e0-094a736510a5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:51.802150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b442c5-c4e9-456f-9db1-fb4762be710d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:51.828484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:51.828848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88db108-2f6e-44c7-8ff3-4167c563fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:51.830360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88db108-2f6e-44c7-8ff3-4167c563fe61 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:51.831048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88db108-2f6e-44c7-8ff3-4167c563fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:51.831842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88db108-2f6e-44c7-8ff3-4167c563fe61 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:51.832768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88db108-2f6e-44c7-8ff3-4167c563fe61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:51.835716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88db108-2f6e-44c7-8ff3-4167c563fe61 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:51.852716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf02a6d-c795-4195-9ab6-940c37a7a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:51.853622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf02a6d-c795-4195-9ab6-940c37a7a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:51.853885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf02a6d-c795-4195-9ab6-940c37a7a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:51.854252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf02a6d-c795-4195-9ab6-940c37a7a1d6 None admin] PATH_INFO: `/v3/users/3ed4110e219a4ee3ab964f74d40767d8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:51.863844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 117/242] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:54:51 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:54:51.865805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa010c0b-f25e-4fde-86c2-bbf15a4215a7 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:51.866660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa010c0b-f25e-4fde-86c2-bbf15a4215a7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:51.867500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa010c0b-f25e-4fde-86c2-bbf15a4215a7 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:51.869477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 118/243] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:51.870843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf02a6d-c795-4195-9ab6-940c37a7a1d6 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed4110e219a4ee3ab964f74d40767d8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:51.872357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf02a6d-c795-4195-9ab6-940c37a7a1d6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:51.874244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 126/244] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:51 2022] GET /identity/v3/users/3ed4110e219a4ee3ab964f74d40767d8 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:51.875558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851fb75-7baa-4d54-938d-0d21474256f3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:51.876075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851fb75-7baa-4d54-938d-0d21474256f3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:51.876618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851fb75-7baa-4d54-938d-0d21474256f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:51.882762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf02a6d-c795-4195-9ab6-940c37a7a1d6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:51.901548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f851fb75-7baa-4d54-938d-0d21474256f3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:51.903258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f851fb75-7baa-4d54-938d-0d21474256f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:51.990020 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 119/245] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:52.017385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf02a6d-c795-4195-9ab6-940c37a7a1d6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:52.060157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db5579-9805-4847-98e9-17ea30ec69d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:52.060820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db5579-9805-4847-98e9-17ea30ec69d0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:52.061137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db5579-9805-4847-98e9-17ea30ec69d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:52.061357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db5579-9805-4847-98e9-17ea30ec69d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:52.110584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:52.153894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db5579-9805-4847-98e9-17ea30ec69d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:52.156267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db5579-9805-4847-98e9-17ea30ec69d0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:52.296565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 127/246] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:52.298053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851fb75-7baa-4d54-938d-0d21474256f3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:52.344907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:52.427317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851fb75-7baa-4d54-938d-0d21474256f3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:52.476943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca56c94-7989-4ebe-8101-abef49a0674a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:52.478199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56c94-7989-4ebe-8101-abef49a0674a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:52.478664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56c94-7989-4ebe-8101-abef49a0674a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:52.479113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56c94-7989-4ebe-8101-abef49a0674a None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:52.481265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca56c94-7989-4ebe-8101-abef49a0674a None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:52.482954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca56c94-7989-4ebe-8101-abef49a0674a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:52.485253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 120/247] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:52 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:52.491247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db5579-9805-4847-98e9-17ea30ec69d0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:52.505917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca56c94-7989-4ebe-8101-abef49a0674a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:52.610680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:52.642466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca56c94-7989-4ebe-8101-abef49a0674a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:52.645663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:52.652478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db5579-9805-4847-98e9-17ea30ec69d0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:52.685105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be90c88-ddca-4729-a6cb-68d7cf0540ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:52.686084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be90c88-ddca-4729-a6cb-68d7cf0540ce None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:52.686543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be90c88-ddca-4729-a6cb-68d7cf0540ce None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:52.686995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be90c88-ddca-4729-a6cb-68d7cf0540ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:52.701487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be90c88-ddca-4729-a6cb-68d7cf0540ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:52.704846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46827fb5-58df-492d-8430-a108dd1ebcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:52.705624 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46827fb5-58df-492d-8430-a108dd1ebcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:52.706040 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46827fb5-58df-492d-8430-a108dd1ebcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:52.706386 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46827fb5-58df-492d-8430-a108dd1ebcb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:52.707410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46827fb5-58df-492d-8430-a108dd1ebcb9 None admin] RBAC: Adding query filter params (role.id=15e6445cc58a46448b7b3bdff71f24d8, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9, user.id=3ed4110e219a4ee3ab964f74d40767d8) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:52.707827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46827fb5-58df-492d-8430-a108dd1ebcb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7be90c88-ddca-4729-a6cb-68d7cf0540ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:52.708464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:52.709331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:52.710100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:52.710687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46827fb5-58df-492d-8430-a108dd1ebcb9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:52.713003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 121/248] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:52.719294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be90c88-ddca-4729-a6cb-68d7cf0540ce None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:52.722929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 128/249] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:52 2022] GET /identity/v3/role_assignments?user.id=3ed4110e219a4ee3ab964f74d40767d8&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=15e6445cc58a46448b7b3bdff71f24d8 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:52.836453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b69974-ec5e-4c67-8ba6-e4aae52766ee None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:52.836998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b69974-ec5e-4c67-8ba6-e4aae52766ee None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:52.837471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b69974-ec5e-4c67-8ba6-e4aae52766ee None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:52.839767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 129/250] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:52.845831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738eb2b-6bbf-4cef-91ac-9de90d891179 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:52.846166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be90c88-ddca-4729-a6cb-68d7cf0540ce None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:52.846272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738eb2b-6bbf-4cef-91ac-9de90d891179 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:52.846696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738eb2b-6bbf-4cef-91ac-9de90d891179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:52.886052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58e4f-6acb-4742-b1ce-254279682518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:52.886909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58e4f-6acb-4742-b1ce-254279682518 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:52.887337 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58e4f-6acb-4742-b1ce-254279682518 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:52.887746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58e4f-6acb-4742-b1ce-254279682518 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:52.888677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58e4f-6acb-4742-b1ce-254279682518 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:52.889118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58e4f-6acb-4742-b1ce-254279682518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:52.890689 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58e4f-6acb-4742-b1ce-254279682518 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:52.893766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2738eb2b-6bbf-4cef-91ac-9de90d891179 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:52.895122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2738eb2b-6bbf-4cef-91ac-9de90d891179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:52.901779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 122/251] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:52.914496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58e4f-6acb-4742-b1ce-254279682518 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:52.958490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:53.009783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 130/252] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:53.012089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729e92-b04c-4cfc-b372-a14be42d4b7e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:53.012733 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729e92-b04c-4cfc-b372-a14be42d4b7e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:53.013289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729e92-b04c-4cfc-b372-a14be42d4b7e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:53.020495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 131/253] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:53.024550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675c282-1822-4645-9274-bb7d6f5722c7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:53.024550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675c282-1822-4645-9274-bb7d6f5722c7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:53.024550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675c282-1822-4645-9274-bb7d6f5722c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:53.051860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6675c282-1822-4645-9274-bb7d6f5722c7 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:53.053901 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6675c282-1822-4645-9274-bb7d6f5722c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:53.060910 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58e4f-6acb-4742-b1ce-254279682518 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:53.114141 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f26e5-a8cb-4df7-bcb0-e31154f44b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:53.115097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f26e5-a8cb-4df7-bcb0-e31154f44b59 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:53.115578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f26e5-a8cb-4df7-bcb0-e31154f44b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:53.116024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f26e5-a8cb-4df7-bcb0-e31154f44b59 None admin] PATH_INFO: `/v3/users/4c90d4fcbdda4a1fba569c85280b225d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:53.117748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f26e5-a8cb-4df7-bcb0-e31154f44b59 None admin] RBAC: Authorizing `identity:get_user(user_id=4c90d4fcbdda4a1fba569c85280b225d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:53.119585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f26e5-a8cb-4df7-bcb0-e31154f44b59 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:53.130853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 123/254] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:52 2022] GET /identity/v3/users/4c90d4fcbdda4a1fba569c85280b225d => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:53.132081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f26e5-a8cb-4df7-bcb0-e31154f44b59 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:53.170115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:53.184002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 132/255] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:53.265500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:53.272646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f26e5-a8cb-4df7-bcb0-e31154f44b59 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:53.311638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c264b-b0fd-4712-8a6d-5841d2a8b420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:53.312418 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c264b-b0fd-4712-8a6d-5841d2a8b420 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:53.312662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c264b-b0fd-4712-8a6d-5841d2a8b420 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:53.312944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c264b-b0fd-4712-8a6d-5841d2a8b420 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:53.314098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c264b-b0fd-4712-8a6d-5841d2a8b420 None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:53.315548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c264b-b0fd-4712-8a6d-5841d2a8b420 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:53.317213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 124/256] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:53 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:53.323134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675c282-1822-4645-9274-bb7d6f5722c7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:53.432701 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675c282-1822-4645-9274-bb7d6f5722c7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:53.469737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fe85d-ba40-4b68-9635-db3f4f966204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:53.470414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fe85d-ba40-4b68-9635-db3f4f966204 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:53.470694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fe85d-ba40-4b68-9635-db3f4f966204 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:53.470968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fe85d-ba40-4b68-9635-db3f4f966204 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/users/4c90d4fcbdda4a1fba569c85280b225d/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:53.474496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fe85d-ba40-4b68-9635-db3f4f966204 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4ae55af10f4cf08c544a37c7f275d9, user_id=4c90d4fcbdda4a1fba569c85280b225d, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:53.475613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fe85d-ba40-4b68-9635-db3f4f966204 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:53.491077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 133/257] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:54:53 2022] PUT /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/users/4c90d4fcbdda4a1fba569c85280b225d/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:54:53.509532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c264b-b0fd-4712-8a6d-5841d2a8b420 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:53.666397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c264b-b0fd-4712-8a6d-5841d2a8b420 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:53.732097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc697c56-8d95-4862-bc27-ec2470d3c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:53.733219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc697c56-8d95-4862-bc27-ec2470d3c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:53.733709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc697c56-8d95-4862-bc27-ec2470d3c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:53.734185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc697c56-8d95-4862-bc27-ec2470d3c3b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:53.753442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc697c56-8d95-4862-bc27-ec2470d3c3b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-cc697c56-8d95-4862-bc27-ec2470d3c3b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:53.761807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:53.763122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:54:53.763970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:53.766989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 125/258] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:54:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:53.775432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fe85d-ba40-4b68-9635-db3f4f966204 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:53.777656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc697c56-8d95-4862-bc27-ec2470d3c3b2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:53.818342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:53.854775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:53.907722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fe85d-ba40-4b68-9635-db3f4f966204 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:53.922824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc697c56-8d95-4862-bc27-ec2470d3c3b2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:53.945570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42938a-14ea-45f9-a198-347533225879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:53.946764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42938a-14ea-45f9-a198-347533225879 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:53.947044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42938a-14ea-45f9-a198-347533225879 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:53.947353 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42938a-14ea-45f9-a198-347533225879 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:53.948092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42938a-14ea-45f9-a198-347533225879 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:53.948442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42938a-14ea-45f9-a198-347533225879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:53.949838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42938a-14ea-45f9-a198-347533225879 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:53.958838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 134/259] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:54:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:53.965027 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42938a-14ea-45f9-a198-347533225879 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:53.966063 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55557b-04c1-4fdf-9fa2-cd363e72d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:53.967317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55557b-04c1-4fdf-9fa2-cd363e72d828 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:53.967877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55557b-04c1-4fdf-9fa2-cd363e72d828 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:53.968379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55557b-04c1-4fdf-9fa2-cd363e72d828 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:53.980317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55557b-04c1-4fdf-9fa2-cd363e72d828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-af55557b-04c1-4fdf-9fa2-cd363e72d828 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:53.986431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:53.987440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:54:53.988237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:53.990587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 126/260] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:54:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:53.997456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55557b-04c1-4fdf-9fa2-cd363e72d828 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:54.072305 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42938a-14ea-45f9-a198-347533225879 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:54.093825 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:54.116500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebc946-8bb5-4be4-af2c-fe82c553bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:54.117271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebc946-8bb5-4be4-af2c-fe82c553bd1f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:54.118077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebc946-8bb5-4be4-af2c-fe82c553bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:54.119133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebc946-8bb5-4be4-af2c-fe82c553bd1f None admin] PATH_INFO: `/v3/users/d5d6828b32dd477ca9a276bc3a27bf46` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:54.122250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebc946-8bb5-4be4-af2c-fe82c553bd1f None admin] RBAC: Authorizing `identity:get_user(user_id=d5d6828b32dd477ca9a276bc3a27bf46)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:54.127017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebc946-8bb5-4be4-af2c-fe82c553bd1f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:54.127017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 135/261] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:53 2022] GET /identity/v3/users/d5d6828b32dd477ca9a276bc3a27bf46 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:54.137579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebc946-8bb5-4be4-af2c-fe82c553bd1f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:54.172098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:54.209399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55557b-04c1-4fdf-9fa2-cd363e72d828 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:54.301165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752cafa-44cb-48f5-92f8-967460fd6389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:54.301725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cafa-44cb-48f5-92f8-967460fd6389 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:54.301996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebc946-8bb5-4be4-af2c-fe82c553bd1f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:54.302117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cafa-44cb-48f5-92f8-967460fd6389 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:54.302271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cafa-44cb-48f5-92f8-967460fd6389 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:54.302975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752cafa-44cb-48f5-92f8-967460fd6389 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:54.303286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752cafa-44cb-48f5-92f8-967460fd6389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:54.304718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752cafa-44cb-48f5-92f8-967460fd6389 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:54.327946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 127/262] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:54.338250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752cafa-44cb-48f5-92f8-967460fd6389 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:54.339434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b4802-d79c-46a5-b5cd-af05bdc1b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:54.340072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b4802-d79c-46a5-b5cd-af05bdc1b068 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:54.340385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b4802-d79c-46a5-b5cd-af05bdc1b068 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:54.340667 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b4802-d79c-46a5-b5cd-af05bdc1b068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:54.404761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:54.417881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b4802-d79c-46a5-b5cd-af05bdc1b068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:54.419374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b4802-d79c-46a5-b5cd-af05bdc1b068 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:54.535929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 136/263] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:54.537990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752cafa-44cb-48f5-92f8-967460fd6389 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:54.541894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b4802-d79c-46a5-b5cd-af05bdc1b068 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:54.609231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca9c3e-a088-49e4-8f54-eadb83f66ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:54.609828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca9c3e-a088-49e4-8f54-eadb83f66ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:54.610120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca9c3e-a088-49e4-8f54-eadb83f66ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:54.610408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca9c3e-a088-49e4-8f54-eadb83f66ce4 None admin] PATH_INFO: `/v3/users/d5d6828b32dd477ca9a276bc3a27bf46` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:54.617123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca9c3e-a088-49e4-8f54-eadb83f66ce4 None admin] RBAC: Authorizing `identity:get_user(user_id=d5d6828b32dd477ca9a276bc3a27bf46)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:54.619630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca9c3e-a088-49e4-8f54-eadb83f66ce4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:54.621355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 128/264] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:54 2022] GET /identity/v3/users/d5d6828b32dd477ca9a276bc3a27bf46 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:54.627046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca9c3e-a088-49e4-8f54-eadb83f66ce4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:54.651474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:54.661716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:54.661879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b4802-d79c-46a5-b5cd-af05bdc1b068 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:54.701642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6109116-a461-4d47-bb82-5da67225247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:54.702259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109116-a461-4d47-bb82-5da67225247b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:54.702541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109116-a461-4d47-bb82-5da67225247b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:54.702817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109116-a461-4d47-bb82-5da67225247b None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:54.703955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6109116-a461-4d47-bb82-5da67225247b None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:54.705517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6109116-a461-4d47-bb82-5da67225247b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:54.707529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 137/265] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:54 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:54.713275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6109116-a461-4d47-bb82-5da67225247b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:54.821760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6109116-a461-4d47-bb82-5da67225247b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:54.847381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca9c3e-a088-49e4-8f54-eadb83f66ce4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:54.859734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0c8b7-5659-47b1-bfe0-8828dc2791ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:54.860273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0c8b7-5659-47b1-bfe0-8828dc2791ed None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:54.860581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0c8b7-5659-47b1-bfe0-8828dc2791ed None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:54.860856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0c8b7-5659-47b1-bfe0-8828dc2791ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:54.861586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0c8b7-5659-47b1-bfe0-8828dc2791ed None admin] RBAC: Adding query filter params (role.id=5923fa436ead4ac4b096b40af8672f94, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9, user.id=d5d6828b32dd477ca9a276bc3a27bf46) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:54.861896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0c8b7-5659-47b1-bfe0-8828dc2791ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:54.863352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0c8b7-5659-47b1-bfe0-8828dc2791ed None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:54.871136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 138/266] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:54 2022] GET /identity/v3/role_assignments?user.id=d5d6828b32dd477ca9a276bc3a27bf46&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=5923fa436ead4ac4b096b40af8672f94 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:54.912145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c633-547c-4fa9-90e0-39b3d662bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:54.912815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c633-547c-4fa9-90e0-39b3d662bc18 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:54.913105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c633-547c-4fa9-90e0-39b3d662bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:54.913384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c633-547c-4fa9-90e0-39b3d662bc18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:55.023826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804c633-547c-4fa9-90e0-39b3d662bc18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:55.027217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804c633-547c-4fa9-90e0-39b3d662bc18 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:55.053447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:55.162392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 129/267] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:55.169104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0c8b7-5659-47b1-bfe0-8828dc2791ed None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:55.193935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:55.285702 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0c8b7-5659-47b1-bfe0-8828dc2791ed None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:55.327504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb07de5-33a0-4da3-b948-01382654696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:55.328160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07de5-33a0-4da3-b948-01382654696f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:55.328498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07de5-33a0-4da3-b948-01382654696f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:55.328743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07de5-33a0-4da3-b948-01382654696f None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:55.333080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb07de5-33a0-4da3-b948-01382654696f None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:55.334561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb07de5-33a0-4da3-b948-01382654696f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:55.336340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 139/268] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:55 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:55.342795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c633-547c-4fa9-90e0-39b3d662bc18 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:55.457529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c633-547c-4fa9-90e0-39b3d662bc18 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:55.496740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:55.501450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bff24-bc07-4990-9bb2-1956669224c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:55.502423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bff24-bc07-4990-9bb2-1956669224c7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:55.502713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bff24-bc07-4990-9bb2-1956669224c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:55.502999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bff24-bc07-4990-9bb2-1956669224c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:55.503761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bff24-bc07-4990-9bb2-1956669224c7 None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9, user.id=d5d6828b32dd477ca9a276bc3a27bf46) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:55.504519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bff24-bc07-4990-9bb2-1956669224c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:55.506373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bff24-bc07-4990-9bb2-1956669224c7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:55.514340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 130/269] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:55 2022] GET /identity/v3/role_assignments?user.id=d5d6828b32dd477ca9a276bc3a27bf46&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:55.683063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d350a-c9f0-4c01-8050-6939c8d0e29c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:55.683949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d350a-c9f0-4c01-8050-6939c8d0e29c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:55.684618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d350a-c9f0-4c01-8050-6939c8d0e29c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:55.686536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 140/270] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:54:55.692425 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56e71-1cb8-49e3-8def-eb010b2bd96c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:55.692717 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56e71-1cb8-49e3-8def-eb010b2bd96c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:55.692993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56e71-1cb8-49e3-8def-eb010b2bd96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:55.715597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-95f56e71-1cb8-49e3-8def-eb010b2bd96c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:55.718060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-95f56e71-1cb8-49e3-8def-eb010b2bd96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:55.798134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 131/271] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:55.975020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910a817-0c3e-431a-b9c9-11b8bc5d5312 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:55.975999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910a817-0c3e-431a-b9c9-11b8bc5d5312 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:55.976513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910a817-0c3e-431a-b9c9-11b8bc5d5312 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:55.978081 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 141/272] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:55.983788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50879-b9d0-4879-a4fa-267e73addf97 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:55.984253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50879-b9d0-4879-a4fa-267e73addf97 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:55.984355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50879-b9d0-4879-a4fa-267e73addf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:56.008889 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-cca50879-b9d0-4879-a4fa-267e73addf97 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:56.010537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cca50879-b9d0-4879-a4fa-267e73addf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:56.015309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da20fc8-09dc-4414-bdf0-c0ccea99c111 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:56.015883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da20fc8-09dc-4414-bdf0-c0ccea99c111 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:56.016471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da20fc8-09dc-4414-bdf0-c0ccea99c111 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:56.018293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 142/273] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:56.023156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c784a-c289-418a-878e-6d190ec30d5f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:56.023441 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c784a-c289-418a-878e-6d190ec30d5f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:56.023714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c784a-c289-418a-878e-6d190ec30d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:56.056360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ac2c784a-c289-418a-878e-6d190ec30d5f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:56.057590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ac2c784a-c289-418a-878e-6d190ec30d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:56.105683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 132/274] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:56.135248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50879-b9d0-4879-a4fa-267e73addf97 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:56.158193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 143/275] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:56.181797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:56.262136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50879-b9d0-4879-a4fa-267e73addf97 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:56.306236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a8e3a-8308-4bb6-80a0-c09cf4fee9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:56.307265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a8e3a-8308-4bb6-80a0-c09cf4fee9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:56.307751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a8e3a-8308-4bb6-80a0-c09cf4fee9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:56.308249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a8e3a-8308-4bb6-80a0-c09cf4fee9b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:56.309700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a8e3a-8308-4bb6-80a0-c09cf4fee9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:56.311466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a8e3a-8308-4bb6-80a0-c09cf4fee9b3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:56.313720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 133/276] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:56.319134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c784a-c289-418a-878e-6d190ec30d5f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:56.344257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:56.434411 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c784a-c289-418a-878e-6d190ec30d5f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:56.454954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a8e3a-8308-4bb6-80a0-c09cf4fee9b3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:56.475585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1e6f-9592-4b86-a9eb-648176e95c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:56.476638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1e6f-9592-4b86-a9eb-648176e95c9c None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:56.476952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1e6f-9592-4b86-a9eb-648176e95c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:56.478111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1e6f-9592-4b86-a9eb-648176e95c9c None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:56.478898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1e6f-9592-4b86-a9eb-648176e95c9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:56.480918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1e6f-9592-4b86-a9eb-648176e95c9c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:56.511520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 144/277] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:54:56 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:54:56.512460 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1e6f-9592-4b86-a9eb-648176e95c9c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:56.590041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a8e3a-8308-4bb6-80a0-c09cf4fee9b3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:56.608242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:56.630809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:56.635015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a107-75fc-43f7-bf11-554b461ee063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:56.635935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a107-75fc-43f7-bf11-554b461ee063 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:56.636496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a107-75fc-43f7-bf11-554b461ee063 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:56.636994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a107-75fc-43f7-bf11-554b461ee063 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:56.651127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3a107-75fc-43f7-bf11-554b461ee063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-05c3a107-75fc-43f7-bf11-554b461ee063 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:56.657935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:56.658944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:56.660802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 134/278] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:54:56.671162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a107-75fc-43f7-bf11-554b461ee063 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:56.678465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1e6f-9592-4b86-a9eb-648176e95c9c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:56.726319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9e554-ef94-4122-a71f-0d84e1332acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:56.727524 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9e554-ef94-4122-a71f-0d84e1332acc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:56.727768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9e554-ef94-4122-a71f-0d84e1332acc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:56.728047 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9e554-ef94-4122-a71f-0d84e1332acc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:56.743726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9e554-ef94-4122-a71f-0d84e1332acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-49d9e554-ef94-4122-a71f-0d84e1332acc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:56.750205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:56.751249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:56.752527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 145/279] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:56.757239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9e554-ef94-4122-a71f-0d84e1332acc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:56.811388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a107-75fc-43f7-bf11-554b461ee063 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:56.857048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10443235-9a8a-4982-b5c2-029da01bd070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:56.857743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10443235-9a8a-4982-b5c2-029da01bd070 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:56.858304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10443235-9a8a-4982-b5c2-029da01bd070 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:56.858304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10443235-9a8a-4982-b5c2-029da01bd070 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:56.858964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10443235-9a8a-4982-b5c2-029da01bd070 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:56.859279 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10443235-9a8a-4982-b5c2-029da01bd070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:56.860779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10443235-9a8a-4982-b5c2-029da01bd070 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:56.872560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 135/280] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:56.874335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fa5e6-35f3-4e1a-96ae-b2b839ed6aca None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:56.874822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fa5e6-35f3-4e1a-96ae-b2b839ed6aca None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:56.875306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fa5e6-35f3-4e1a-96ae-b2b839ed6aca None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:56.876859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 136/281] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:56.881454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fa5e6-35f3-4e1a-96ae-b2b839ed6aca None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:56.893505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9e554-ef94-4122-a71f-0d84e1332acc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:56.915992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:56.950545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f80745-2631-454d-81e1-4f89141a703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:56.951324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80745-2631-454d-81e1-4f89141a703e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:56.951722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80745-2631-454d-81e1-4f89141a703e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:56.952074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80745-2631-454d-81e1-4f89141a703e None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:56.952885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f80745-2631-454d-81e1-4f89141a703e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:56.953290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f80745-2631-454d-81e1-4f89141a703e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:56.954779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f80745-2631-454d-81e1-4f89141a703e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:56.956672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:56.975946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 146/282] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:56.978291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912723-143a-4314-8af9-875776f46445 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:56.978683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912723-143a-4314-8af9-875776f46445 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:56.979774 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912723-143a-4314-8af9-875776f46445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:57.002203 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-53912723-143a-4314-8af9-875776f46445 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:57.003741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-53912723-143a-4314-8af9-875776f46445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:57.026880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fa5e6-35f3-4e1a-96ae-b2b839ed6aca None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:57.065319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b648fe-ae49-4b2b-a08b-27cc84ad8b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:57.065880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b648fe-ae49-4b2b-a08b-27cc84ad8b83 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:57.066169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b648fe-ae49-4b2b-a08b-27cc84ad8b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:57.066616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b648fe-ae49-4b2b-a08b-27cc84ad8b83 None admin] PATH_INFO: `/v3/users/0caf296e87174f9bbea8a10ddaf4bd68` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:57.082834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b648fe-ae49-4b2b-a08b-27cc84ad8b83 None admin] RBAC: Authorizing `identity:get_user(user_id=0caf296e87174f9bbea8a10ddaf4bd68)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:57.084446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b648fe-ae49-4b2b-a08b-27cc84ad8b83 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:57.086498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 137/283] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:56 2022] GET /identity/v3/users/0caf296e87174f9bbea8a10ddaf4bd68 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:57.087462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b648fe-ae49-4b2b-a08b-27cc84ad8b83 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:57.101251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 147/284] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:57.103153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912723-143a-4314-8af9-875776f46445 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:57.244870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912723-143a-4314-8af9-875776f46445 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:57.284295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32146f-c422-4e7b-90dc-b89983108568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:57.285122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32146f-c422-4e7b-90dc-b89983108568 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:57.285655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32146f-c422-4e7b-90dc-b89983108568 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:57.286086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32146f-c422-4e7b-90dc-b89983108568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:57.286960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32146f-c422-4e7b-90dc-b89983108568 None admin] RBAC: Adding query filter params (role.id=2db61e25a9cb41608fb5c1dd7983e1d9, user.id=0caf296e87174f9bbea8a10ddaf4bd68, scope.system=all) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:57.287371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32146f-c422-4e7b-90dc-b89983108568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:57.289167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32146f-c422-4e7b-90dc-b89983108568 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:57.295394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:57.295695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 148/285] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Aug 31 00:54:57 2022] GET /identity/v3/role_assignments?user.id=0caf296e87174f9bbea8a10ddaf4bd68&scope.system=all&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:57.354860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:57.384143 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b648fe-ae49-4b2b-a08b-27cc84ad8b83 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:57.392570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32146f-c422-4e7b-90dc-b89983108568 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:57.521093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8552f6-7daf-45c7-9862-bb5533dd4c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:57.521763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8552f6-7daf-45c7-9862-bb5533dd4c58 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:57.522048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8552f6-7daf-45c7-9862-bb5533dd4c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:57.522323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8552f6-7daf-45c7-9862-bb5533dd4c58 None admin] PATH_INFO: `/v3/users/3ed4110e219a4ee3ab964f74d40767d8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:57.524458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32146f-c422-4e7b-90dc-b89983108568 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:57.529323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8552f6-7daf-45c7-9862-bb5533dd4c58 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed4110e219a4ee3ab964f74d40767d8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:57.530877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8552f6-7daf-45c7-9862-bb5533dd4c58 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:57.532641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 138/286] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:57 2022] GET /identity/v3/users/3ed4110e219a4ee3ab964f74d40767d8 => generated 297 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:57.541387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8552f6-7daf-45c7-9862-bb5533dd4c58 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:57.564708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec981465-919d-457e-91bd-796357dd445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:57.565930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec981465-919d-457e-91bd-796357dd445e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:57.566221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec981465-919d-457e-91bd-796357dd445e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:57.566498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec981465-919d-457e-91bd-796357dd445e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:57.579363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec981465-919d-457e-91bd-796357dd445e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ec981465-919d-457e-91bd-796357dd445e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:57.585425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:57.587851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:54:57.589499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 149/287] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:54:57.597056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec981465-919d-457e-91bd-796357dd445e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:57.665551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:57.755102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8552f6-7daf-45c7-9862-bb5533dd4c58 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:57.783247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec981465-919d-457e-91bd-796357dd445e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:57.834492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afc4df-6d03-4dff-bcf0-91ce7b2883fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:57.835400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc4df-6d03-4dff-bcf0-91ce7b2883fc None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:57.835853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc4df-6d03-4dff-bcf0-91ce7b2883fc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:57.836828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc4df-6d03-4dff-bcf0-91ce7b2883fc None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:57.842538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afc4df-6d03-4dff-bcf0-91ce7b2883fc None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:57.845127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2c58f-ada1-4273-a1b0-4716699b3858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:57.845758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2c58f-ada1-4273-a1b0-4716699b3858 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:57.846040 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2c58f-ada1-4273-a1b0-4716699b3858 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:57.846285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afc4df-6d03-4dff-bcf0-91ce7b2883fc None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:57.846432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2c58f-ada1-4273-a1b0-4716699b3858 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:57.846986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2c58f-ada1-4273-a1b0-4716699b3858 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:57.847295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2c58f-ada1-4273-a1b0-4716699b3858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:57.852595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2c58f-ada1-4273-a1b0-4716699b3858 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:57.855408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 139/288] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:57 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:57.864411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afc4df-6d03-4dff-bcf0-91ce7b2883fc None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:57.872358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 150/289] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:57.879661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2c58f-ada1-4273-a1b0-4716699b3858 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:57.915698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:58.047505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2c58f-ada1-4273-a1b0-4716699b3858 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:58.069449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:58.091456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afc4df-6d03-4dff-bcf0-91ce7b2883fc None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:58.111986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da98e58-71c3-4049-9210-850405754657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:58.114724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da98e58-71c3-4049-9210-850405754657 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:58.115059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da98e58-71c3-4049-9210-850405754657 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:58.115337 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da98e58-71c3-4049-9210-850405754657 None admin] PATH_INFO: `/v3/users/4c90d4fcbdda4a1fba569c85280b225d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:58.116742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da98e58-71c3-4049-9210-850405754657 None admin] RBAC: Authorizing `identity:get_user(user_id=4c90d4fcbdda4a1fba569c85280b225d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:58.118861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da98e58-71c3-4049-9210-850405754657 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:58.124519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 151/290] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:54:57 2022] GET /identity/v3/users/4c90d4fcbdda4a1fba569c85280b225d => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:58.126815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da98e58-71c3-4049-9210-850405754657 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:58.170628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc6591-a619-4326-a598-f89c961bb767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:58.173088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc6591-a619-4326-a598-f89c961bb767 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:58.174445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc6591-a619-4326-a598-f89c961bb767 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:58.177502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc6591-a619-4326-a598-f89c961bb767 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/users/3ed4110e219a4ee3ab964f74d40767d8/roles/15e6445cc58a46448b7b3bdff71f24d8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:58.181404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc6591-a619-4326-a598-f89c961bb767 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4ae55af10f4cf08c544a37c7f275d9, user_id=3ed4110e219a4ee3ab964f74d40767d8, role_id=15e6445cc58a46448b7b3bdff71f24d8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:58.183094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc6591-a619-4326-a598-f89c961bb767 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:58.226660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 140/291] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:54:57 2022] PUT /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/users/3ed4110e219a4ee3ab964f74d40767d8/roles/15e6445cc58a46448b7b3bdff71f24d8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:54:58.303449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da98e58-71c3-4049-9210-850405754657 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:58.355972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289b6a5-be3a-4665-b606-683bae55d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:58.356914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289b6a5-be3a-4665-b606-683bae55d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:58.357375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289b6a5-be3a-4665-b606-683bae55d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:58.357857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289b6a5-be3a-4665-b606-683bae55d1c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:58.432437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:58.457667 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289b6a5-be3a-4665-b606-683bae55d1c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:58.459407 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289b6a5-be3a-4665-b606-683bae55d1c4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:58.580195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 152/292] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:54:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:54:58.586771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc6591-a619-4326-a598-f89c961bb767 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:58.728788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:58.749728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc6591-a619-4326-a598-f89c961bb767 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:58.792152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e0987-487d-4252-9497-f8d73da96c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:58.793185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e0987-487d-4252-9497-f8d73da96c33 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:58.793658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e0987-487d-4252-9497-f8d73da96c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:58.794137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e0987-487d-4252-9497-f8d73da96c33 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:58.796058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e0987-487d-4252-9497-f8d73da96c33 None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:58.798750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e0987-487d-4252-9497-f8d73da96c33 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:58.802016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 141/293] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:54:58 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:54:58.808515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289b6a5-be3a-4665-b606-683bae55d1c4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:58.939117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:58.965002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289b6a5-be3a-4665-b606-683bae55d1c4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:59.014080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbcdc8-d444-4dd9-a50f-73e1128f4493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:59.015043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbcdc8-d444-4dd9-a50f-73e1128f4493 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:59.015539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbcdc8-d444-4dd9-a50f-73e1128f4493 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:59.016036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbcdc8-d444-4dd9-a50f-73e1128f4493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:59.017008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbcdc8-d444-4dd9-a50f-73e1128f4493 None admin] RBAC: Adding query filter params (role.id=2db61e25a9cb41608fb5c1dd7983e1d9, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9, user.id=4c90d4fcbdda4a1fba569c85280b225d) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:59.017541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbcdc8-d444-4dd9-a50f-73e1128f4493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:59.019199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbcdc8-d444-4dd9-a50f-73e1128f4493 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:59.029277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 153/294] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:54:58 2022] GET /identity/v3/role_assignments?user.id=4c90d4fcbdda4a1fba569c85280b225d&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:54:59.098344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8157f6-5fff-45ad-9c1a-4baea0fe32f3 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:59.099040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8157f6-5fff-45ad-9c1a-4baea0fe32f3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:59.099040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8157f6-5fff-45ad-9c1a-4baea0fe32f3 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:59.100605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 142/295] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:59.106842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3269d-1930-4c47-8104-6ee685126f5b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:59.107784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3269d-1930-4c47-8104-6ee685126f5b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:59.108256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3269d-1930-4c47-8104-6ee685126f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:59.142602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e3e3269d-1930-4c47-8104-6ee685126f5b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:59.150165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e3e3269d-1930-4c47-8104-6ee685126f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:59.260615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 154/296] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:59.451294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec3de4-0bf5-413f-b5b3-38d7dd5f56d3 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:59.451740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec3de4-0bf5-413f-b5b3-38d7dd5f56d3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:59.452526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec3de4-0bf5-413f-b5b3-38d7dd5f56d3 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:59.455510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 143/297] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:59.462617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da12921-c478-4728-9935-ed442fcf7be8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:59.463129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da12921-c478-4728-9935-ed442fcf7be8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:59.463624 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da12921-c478-4728-9935-ed442fcf7be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:59.488696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9da12921-c478-4728-9935-ed442fcf7be8 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:59.489910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9da12921-c478-4728-9935-ed442fcf7be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:59.574176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 155/298] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:54:59.594260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec3de4-0bf5-413f-b5b3-38d7dd5f56d3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:59.727470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec3de4-0bf5-413f-b5b3-38d7dd5f56d3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:59.785350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9684c-7d15-48d7-842c-6257a54bce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:59.785726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014b557-e17e-4340-88f3-c67cbcbfe890 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:59.786267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014b557-e17e-4340-88f3-c67cbcbfe890 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:59.786766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014b557-e17e-4340-88f3-c67cbcbfe890 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:59.786961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9684c-7d15-48d7-842c-6257a54bce69 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:59.787424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9684c-7d15-48d7-842c-6257a54bce69 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:59.787918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9684c-7d15-48d7-842c-6257a54bce69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:59.789167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 156/299] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:54:59.795394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc9214-e9b0-486d-ac67-27b2e161e279 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:59.796000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc9214-e9b0-486d-ac67-27b2e161e279 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:59.796541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc9214-e9b0-486d-ac67-27b2e161e279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:59.804567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:59.807377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9684c-7d15-48d7-842c-6257a54bce69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:54:59.817070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ddcc9214-e9b0-486d-ac67-27b2e161e279 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-aca9684c-7d15-48d7-842c-6257a54bce69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:54:59.817525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:54:59.818486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:54:59.819322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 144/300] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:54:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:54:59.822256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ddcc9214-e9b0-486d-ac67-27b2e161e279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:59.826448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9684c-7d15-48d7-842c-6257a54bce69 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:59.872143 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:59.913626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 157/301] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:54:59.916554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc9214-e9b0-486d-ac67-27b2e161e279 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:59.954434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9684c-7d15-48d7-842c-6257a54bce69 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:59.994230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c3ba9-79c6-482b-9a4b-06021383066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:59.995175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c3ba9-79c6-482b-9a4b-06021383066e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:59.995682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c3ba9-79c6-482b-9a4b-06021383066e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:59.996132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c3ba9-79c6-482b-9a4b-06021383066e None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:59.997071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c3ba9-79c6-482b-9a4b-06021383066e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:54:59.997578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c3ba9-79c6-482b-9a4b-06021383066e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:59.999145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c3ba9-79c6-482b-9a4b-06021383066e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:00.009729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 145/302] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:54:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:00.017160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c3ba9-79c6-482b-9a4b-06021383066e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:00.043652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc9214-e9b0-486d-ac67-27b2e161e279 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:00.092475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207237a0-ef87-4110-b825-2e17cfeb878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:00.093155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207237a0-ef87-4110-b825-2e17cfeb878b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:00.093435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207237a0-ef87-4110-b825-2e17cfeb878b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:00.093709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207237a0-ef87-4110-b825-2e17cfeb878b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:00.095251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207237a0-ef87-4110-b825-2e17cfeb878b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:00.097372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207237a0-ef87-4110-b825-2e17cfeb878b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:00.103713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 158/303] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:54:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:00.105947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207237a0-ef87-4110-b825-2e17cfeb878b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:00.109979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:00.135099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:00.176534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c3ba9-79c6-482b-9a4b-06021383066e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:00.213917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55b8b2-cee5-4ad3-8340-aa670db3ee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:00.214550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55b8b2-cee5-4ad3-8340-aa670db3ee4a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:00.214829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55b8b2-cee5-4ad3-8340-aa670db3ee4a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:00.215104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55b8b2-cee5-4ad3-8340-aa670db3ee4a None admin] PATH_INFO: `/v3/users/18ff66052c4e46f0863405bd5c0b0543` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:00.236243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55b8b2-cee5-4ad3-8340-aa670db3ee4a None admin] RBAC: Authorizing `identity:get_user(user_id=18ff66052c4e46f0863405bd5c0b0543)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:00.238874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55b8b2-cee5-4ad3-8340-aa670db3ee4a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:00.244430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 146/304] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:55:00 2022] GET /identity/v3/users/18ff66052c4e46f0863405bd5c0b0543 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:00.249610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55b8b2-cee5-4ad3-8340-aa670db3ee4a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:00.250484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207237a0-ef87-4110-b825-2e17cfeb878b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:00.296121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98fdf7-2cdd-43d9-a7b4-17edf27b4712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:00.296817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98fdf7-2cdd-43d9-a7b4-17edf27b4712 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:00.297096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98fdf7-2cdd-43d9-a7b4-17edf27b4712 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:00.297535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98fdf7-2cdd-43d9-a7b4-17edf27b4712 None admin] PATH_INFO: `/v3/groups` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:00.298175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98fdf7-2cdd-43d9-a7b4-17edf27b4712 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:00.300503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98fdf7-2cdd-43d9-a7b4-17edf27b4712 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:00.325186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 159/305] 10.222.0.83 () {60 vars in 1134 bytes} [Wed Aug 31 00:55:00 2022] POST /identity/v3/groups => generated 229 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:55:00.326110 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98fdf7-2cdd-43d9-a7b4-17edf27b4712 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:00.397104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55b8b2-cee5-4ad3-8340-aa670db3ee4a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:00.412806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:00.439864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:00.450523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b054-a325-46cd-a035-4a03f814a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:00.451522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b054-a325-46cd-a035-4a03f814a048 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:00.451885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b054-a325-46cd-a035-4a03f814a048 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:00.452233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b054-a325-46cd-a035-4a03f814a048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:00.453122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b054-a325-46cd-a035-4a03f814a048 None admin] RBAC: Adding query filter params (role.id=15e6445cc58a46448b7b3bdff71f24d8, user.id=18ff66052c4e46f0863405bd5c0b0543, scope.system=all) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:00.453515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b054-a325-46cd-a035-4a03f814a048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:00.455183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b054-a325-46cd-a035-4a03f814a048 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:00.467467 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 147/306] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Aug 31 00:55:00 2022] GET /identity/v3/role_assignments?user.id=18ff66052c4e46f0863405bd5c0b0543&scope.system=all&role.id=15e6445cc58a46448b7b3bdff71f24d8 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:00.471002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98fdf7-2cdd-43d9-a7b4-17edf27b4712 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:00.514638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5ddbf-e61d-4fea-b3b3-e8d17c18531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:00.515232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ddbf-e61d-4fea-b3b3-e8d17c18531c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:00.515496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ddbf-e61d-4fea-b3b3-e8d17c18531c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:00.515776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ddbf-e61d-4fea-b3b3-e8d17c18531c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:00.529965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5ddbf-e61d-4fea-b3b3-e8d17c18531c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3dc5ddbf-e61d-4fea-b3b3-e8d17c18531c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:00.535590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:00.537965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:00.539811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 160/307] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:00.547860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b054-a325-46cd-a035-4a03f814a048 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:00.672676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b054-a325-46cd-a035-4a03f814a048 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:00.686917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714ac1b-9e02-4329-ab0b-fc79449bc6c0 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:00.687207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714ac1b-9e02-4329-ab0b-fc79449bc6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:00.687490 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714ac1b-9e02-4329-ab0b-fc79449bc6c0 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:00.689181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 161/308] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:00.694439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef212461-eabc-4a45-a983-b5517dd2de9c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:00.694726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef212461-eabc-4a45-a983-b5517dd2de9c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:00.694991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef212461-eabc-4a45-a983-b5517dd2de9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:00.713564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ef212461-eabc-4a45-a983-b5517dd2de9c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:00.714914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ef212461-eabc-4a45-a983-b5517dd2de9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:00.717622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13233db2-e24b-49e5-bc6b-cb95d43bffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:00.718826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13233db2-e24b-49e5-bc6b-cb95d43bffbd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:00.719611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13233db2-e24b-49e5-bc6b-cb95d43bffbd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:00.720167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13233db2-e24b-49e5-bc6b-cb95d43bffbd None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:00.721186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13233db2-e24b-49e5-bc6b-cb95d43bffbd None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:00.721755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13233db2-e24b-49e5-bc6b-cb95d43bffbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:00.723508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13233db2-e24b-49e5-bc6b-cb95d43bffbd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:00.734640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 148/309] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:00.744663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13233db2-e24b-49e5-bc6b-cb95d43bffbd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:00.791781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 162/310] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:00.816483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:00.874817 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13233db2-e24b-49e5-bc6b-cb95d43bffbd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:00.924544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15634-540a-4d18-910b-96cf00c0bfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:00.925720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15634-540a-4d18-910b-96cf00c0bfca None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:00.926229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15634-540a-4d18-910b-96cf00c0bfca None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:00.926731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15634-540a-4d18-910b-96cf00c0bfca None admin] PATH_INFO: `/v3/users/0caf296e87174f9bbea8a10ddaf4bd68` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:00.928152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b15634-540a-4d18-910b-96cf00c0bfca None admin] RBAC: Authorizing `identity:get_user(user_id=0caf296e87174f9bbea8a10ddaf4bd68)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:00.929858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b15634-540a-4d18-910b-96cf00c0bfca None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:00.932659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 149/311] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:55:00 2022] GET /identity/v3/users/0caf296e87174f9bbea8a10ddaf4bd68 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:00.940380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef212461-eabc-4a45-a983-b5517dd2de9c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:01.004741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:01.050208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef212461-eabc-4a45-a983-b5517dd2de9c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:01.088852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fabcc0-2b0a-42c5-ae59-8e53d90674a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:01.089580 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fabcc0-2b0a-42c5-ae59-8e53d90674a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:01.089864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fabcc0-2b0a-42c5-ae59-8e53d90674a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:01.090139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fabcc0-2b0a-42c5-ae59-8e53d90674a5 None admin] PATH_INFO: `/v3/system/users/0caf296e87174f9bbea8a10ddaf4bd68/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:01.091632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fabcc0-2b0a-42c5-ae59-8e53d90674a5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0caf296e87174f9bbea8a10ddaf4bd68, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:01.092129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15634-540a-4d18-910b-96cf00c0bfca None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:01.093328 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fabcc0-2b0a-42c5-ae59-8e53d90674a5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:01.103346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 163/312] 10.222.0.83 () {58 vars in 1334 bytes} [Wed Aug 31 00:55:00 2022] PUT /identity/v3/system/users/0caf296e87174f9bbea8a10ddaf4bd68/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:55:01.229672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15634-540a-4d18-910b-96cf00c0bfca None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:01.255463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:01.269804 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d797-f4c0-4453-b6bf-bb3c06f85b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:01.270467 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d797-f4c0-4453-b6bf-bb3c06f85b66 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:01.270756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d797-f4c0-4453-b6bf-bb3c06f85b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:01.271039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d797-f4c0-4453-b6bf-bb3c06f85b66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:01.284996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7d797-f4c0-4453-b6bf-bb3c06f85b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-3ba7d797-f4c0-4453-b6bf-bb3c06f85b66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:01.291412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:01.292292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:01.293110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 150/313] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:01.299713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fabcc0-2b0a-42c5-ae59-8e53d90674a5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:01.423427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fabcc0-2b0a-42c5-ae59-8e53d90674a5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:01.441045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:01.464291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb0c8-7870-4372-b8a2-494d918f81b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:01.465553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb0c8-7870-4372-b8a2-494d918f81b2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:01.465841 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb0c8-7870-4372-b8a2-494d918f81b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:01.466170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb0c8-7870-4372-b8a2-494d918f81b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:01.467118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fb0c8-7870-4372-b8a2-494d918f81b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:01.467426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fb0c8-7870-4372-b8a2-494d918f81b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:01.468904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fb0c8-7870-4372-b8a2-494d918f81b2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:01.480967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 164/314] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:01.489123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d797-f4c0-4453-b6bf-bb3c06f85b66 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:01.611805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d797-f4c0-4453-b6bf-bb3c06f85b66 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:01.659496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010852a8-2318-41a9-958f-33a0dc42908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:01.660567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010852a8-2318-41a9-958f-33a0dc42908e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:01.661035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010852a8-2318-41a9-958f-33a0dc42908e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:01.661490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010852a8-2318-41a9-958f-33a0dc42908e None admin] PATH_INFO: `/v3/users/3ed4110e219a4ee3ab964f74d40767d8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:01.663429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010852a8-2318-41a9-958f-33a0dc42908e None admin] RBAC: Authorizing `identity:get_user(user_id=3ed4110e219a4ee3ab964f74d40767d8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:01.666152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010852a8-2318-41a9-958f-33a0dc42908e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:01.670350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 151/315] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:55:01 2022] GET /identity/v3/users/3ed4110e219a4ee3ab964f74d40767d8 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:01.675674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb0c8-7870-4372-b8a2-494d918f81b2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:01.797615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb0c8-7870-4372-b8a2-494d918f81b2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:01.843628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3e20f-c776-4f99-b4db-3f27c5330435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:01.844314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3e20f-c776-4f99-b4db-3f27c5330435 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:01.844630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3e20f-c776-4f99-b4db-3f27c5330435 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:01.844914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3e20f-c776-4f99-b4db-3f27c5330435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:01.909388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:01.937359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3e20f-c776-4f99-b4db-3f27c5330435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:01.938750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3e20f-c776-4f99-b4db-3f27c5330435 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:02.064217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 165/316] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:02.069875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010852a8-2318-41a9-958f-33a0dc42908e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:02.168258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:02.211239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010852a8-2318-41a9-958f-33a0dc42908e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:02.248262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234467e0-244b-4f1a-8c83-adfd10a0fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:02.249047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234467e0-244b-4f1a-8c83-adfd10a0fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:02.249266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234467e0-244b-4f1a-8c83-adfd10a0fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:02.249615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234467e0-244b-4f1a-8c83-adfd10a0fdd6 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:02.250787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234467e0-244b-4f1a-8c83-adfd10a0fdd6 None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:02.252360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234467e0-244b-4f1a-8c83-adfd10a0fdd6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:02.254328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 152/317] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:02 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:02.260581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3e20f-c776-4f99-b4db-3f27c5330435 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:02.368699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:02.393978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3e20f-c776-4f99-b4db-3f27c5330435 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:02.434740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a4a81-a875-4af4-939a-973e2ff5f1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:02.435454 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a4a81-a875-4af4-939a-973e2ff5f1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:02.435752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a4a81-a875-4af4-939a-973e2ff5f1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:02.436034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a4a81-a875-4af4-939a-973e2ff5f1c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:02.436822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a4a81-a875-4af4-939a-973e2ff5f1c7 None admin] RBAC: Adding query filter params (role.id=15e6445cc58a46448b7b3bdff71f24d8, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9, user.id=3ed4110e219a4ee3ab964f74d40767d8) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:02.437142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a4a81-a875-4af4-939a-973e2ff5f1c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:02.438695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a4a81-a875-4af4-939a-973e2ff5f1c7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:02.446460 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 166/318] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:02 2022] GET /identity/v3/role_assignments?user.id=3ed4110e219a4ee3ab964f74d40767d8&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=15e6445cc58a46448b7b3bdff71f24d8 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:02.527933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a11d4-eb63-437f-a60c-1e65f8124041 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:02.528315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a11d4-eb63-437f-a60c-1e65f8124041 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:02.532053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a11d4-eb63-437f-a60c-1e65f8124041 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:02.532053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 153/319] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:02.538310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cc024-68fd-4d28-8a3b-bd69f7124799 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:02.538889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cc024-68fd-4d28-8a3b-bd69f7124799 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:02.539396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cc024-68fd-4d28-8a3b-bd69f7124799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:02.560185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3f1cc024-68fd-4d28-8a3b-bd69f7124799 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:02.561725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3f1cc024-68fd-4d28-8a3b-bd69f7124799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:02.641437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 167/320] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:02.647674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe22fd-3675-4ad2-8c05-aef943ba3cda None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:02.648053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe22fd-3675-4ad2-8c05-aef943ba3cda None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:02.648352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe22fd-3675-4ad2-8c05-aef943ba3cda None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:02.650308 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 154/321] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:55:02.655837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcc61a-3771-498d-872f-f4d1cd134e5c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:02.656440 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcc61a-3771-498d-872f-f4d1cd134e5c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:02.656440 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcc61a-3771-498d-872f-f4d1cd134e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:02.679225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-80bcc61a-3771-498d-872f-f4d1cd134e5c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:02.681681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-80bcc61a-3771-498d-872f-f4d1cd134e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:02.760986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 168/322] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:02.916376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe22fd-3675-4ad2-8c05-aef943ba3cda None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:03.030815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe22fd-3675-4ad2-8c05-aef943ba3cda None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:03.036365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcc61a-3771-498d-872f-f4d1cd134e5c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:03.038550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:03.052182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:03.073114 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52698ec7-f38f-4b1b-8a98-733cbb48dc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:03.073763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698ec7-f38f-4b1b-8a98-733cbb48dc1b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:03.074046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698ec7-f38f-4b1b-8a98-733cbb48dc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:03.074324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698ec7-f38f-4b1b-8a98-733cbb48dc1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:03.086874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52698ec7-f38f-4b1b-8a98-733cbb48dc1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-52698ec7-f38f-4b1b-8a98-733cbb48dc1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:03.092100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:03.093059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:03.093851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 155/323] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:03.099315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52698ec7-f38f-4b1b-8a98-733cbb48dc1b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:03.167877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcc61a-3771-498d-872f-f4d1cd134e5c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:03.207307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a718-4378-4809-aace-716396e1cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:03.207978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a718-4378-4809-aace-716396e1cd68 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:03.208259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a718-4378-4809-aace-716396e1cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:03.208568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a718-4378-4809-aace-716396e1cd68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:03.209715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565a718-4378-4809-aace-716396e1cd68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:03.211235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565a718-4378-4809-aace-716396e1cd68 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:03.213243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 169/324] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:03.219060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a718-4378-4809-aace-716396e1cd68 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:03.221961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52698ec7-f38f-4b1b-8a98-733cbb48dc1b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:03.264442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678e3e-d4d3-497d-aa51-464eb90b11c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:03.265231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678e3e-d4d3-497d-aa51-464eb90b11c0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:03.265231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678e3e-d4d3-497d-aa51-464eb90b11c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:03.265660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678e3e-d4d3-497d-aa51-464eb90b11c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:03.266178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3678e3e-d4d3-497d-aa51-464eb90b11c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:03.266599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3678e3e-d4d3-497d-aa51-464eb90b11c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:03.267998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3678e3e-d4d3-497d-aa51-464eb90b11c0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:03.278186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 156/325] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:03.283693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678e3e-d4d3-497d-aa51-464eb90b11c0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:03.300420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:03.335008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:03.338564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a718-4378-4809-aace-716396e1cd68 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:03.375491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04129de1-85a9-483c-a8bb-4536bfccb400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:03.376152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04129de1-85a9-483c-a8bb-4536bfccb400 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:03.376404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04129de1-85a9-483c-a8bb-4536bfccb400 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:03.376686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04129de1-85a9-483c-a8bb-4536bfccb400 None admin] PATH_INFO: `/v3/groups` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:03.377317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04129de1-85a9-483c-a8bb-4536bfccb400 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:03.378785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04129de1-85a9-483c-a8bb-4536bfccb400 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:03.395126 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 170/326] 10.222.0.83 () {60 vars in 1134 bytes} [Wed Aug 31 00:55:03 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:55:03.396401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e520-6545-42be-9cbf-3f8247de5e9b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:03.396694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e520-6545-42be-9cbf-3f8247de5e9b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:03.396966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e520-6545-42be-9cbf-3f8247de5e9b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:03.397789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678e3e-d4d3-497d-aa51-464eb90b11c0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:03.398198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 171/327] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:03.404863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1176a1-30d4-4699-8ed6-f4e7d06a98bb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:03.405228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1176a1-30d4-4699-8ed6-f4e7d06a98bb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:03.405470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1176a1-30d4-4699-8ed6-f4e7d06a98bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:03.427172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ac1176a1-30d4-4699-8ed6-f4e7d06a98bb None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:03.428774 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ac1176a1-30d4-4699-8ed6-f4e7d06a98bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:03.444916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b629-408a-4ebd-bdac-b769993183bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:03.446157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b629-408a-4ebd-bdac-b769993183bd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:03.446444 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b629-408a-4ebd-bdac-b769993183bd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:03.446767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b629-408a-4ebd-bdac-b769993183bd None admin] PATH_INFO: `/v3/users/18ff66052c4e46f0863405bd5c0b0543` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:03.448030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b629-408a-4ebd-bdac-b769993183bd None admin] RBAC: Authorizing `identity:get_user(user_id=18ff66052c4e46f0863405bd5c0b0543)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:03.449588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b629-408a-4ebd-bdac-b769993183bd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:03.456228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 157/328] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:55:03 2022] GET /identity/v3/users/18ff66052c4e46f0863405bd5c0b0543 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:03.457467 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b629-408a-4ebd-bdac-b769993183bd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:03.531497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 172/329] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:03.609229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b629-408a-4ebd-bdac-b769993183bd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:03.620009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:03.647803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e70b6-b2bf-40e3-8275-11e7b6ab75c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:03.648520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e70b6-b2bf-40e3-8275-11e7b6ab75c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:03.648852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e70b6-b2bf-40e3-8275-11e7b6ab75c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:03.649167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e70b6-b2bf-40e3-8275-11e7b6ab75c5 None admin] PATH_INFO: `/v3/system/users/18ff66052c4e46f0863405bd5c0b0543/roles/15e6445cc58a46448b7b3bdff71f24d8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:03.661163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e70b6-b2bf-40e3-8275-11e7b6ab75c5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=18ff66052c4e46f0863405bd5c0b0543, role_id=15e6445cc58a46448b7b3bdff71f24d8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:03.662610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e70b6-b2bf-40e3-8275-11e7b6ab75c5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:03.674445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 158/330] 10.222.0.83 () {58 vars in 1334 bytes} [Wed Aug 31 00:55:03 2022] PUT /identity/v3/system/users/18ff66052c4e46f0863405bd5c0b0543/roles/15e6445cc58a46448b7b3bdff71f24d8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:55:03.821907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1176a1-30d4-4699-8ed6-f4e7d06a98bb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:03.907483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:03.969062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1176a1-30d4-4699-8ed6-f4e7d06a98bb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:04.026725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba262e7-1ded-4679-bb8f-07ac7ebe1bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:04.027384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba262e7-1ded-4679-bb8f-07ac7ebe1bbe None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:04.027726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba262e7-1ded-4679-bb8f-07ac7ebe1bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:04.028014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba262e7-1ded-4679-bb8f-07ac7ebe1bbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:04.040802 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba262e7-1ded-4679-bb8f-07ac7ebe1bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-dba262e7-1ded-4679-bb8f-07ac7ebe1bbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:04.050000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:04.050939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:04.051719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:04.052808 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 173/331] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:04.060170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e70b6-b2bf-40e3-8275-11e7b6ab75c5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:04.210303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e70b6-b2bf-40e3-8275-11e7b6ab75c5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:04.255936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c296-2450-4694-8d1f-b39d9ac0836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:04.256603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c296-2450-4694-8d1f-b39d9ac0836e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:04.256894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c296-2450-4694-8d1f-b39d9ac0836e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:04.257174 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c296-2450-4694-8d1f-b39d9ac0836e None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:04.257866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839c296-2450-4694-8d1f-b39d9ac0836e None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:04.258721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839c296-2450-4694-8d1f-b39d9ac0836e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:04.260508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839c296-2450-4694-8d1f-b39d9ac0836e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:04.270277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 159/332] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:04.276306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba262e7-1ded-4679-bb8f-07ac7ebe1bbe None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:04.429495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba262e7-1ded-4679-bb8f-07ac7ebe1bbe None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:04.454672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:04.474751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e35cc-1f8b-4bba-921e-b1b10acc3997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:04.475398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e35cc-1f8b-4bba-921e-b1b10acc3997 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:04.475683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e35cc-1f8b-4bba-921e-b1b10acc3997 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:04.475961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e35cc-1f8b-4bba-921e-b1b10acc3997 None admin] PATH_INFO: `/v3/users/0caf296e87174f9bbea8a10ddaf4bd68` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:04.478037 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e35cc-1f8b-4bba-921e-b1b10acc3997 None admin] RBAC: Authorizing `identity:get_user(user_id=0caf296e87174f9bbea8a10ddaf4bd68)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:04.479502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e35cc-1f8b-4bba-921e-b1b10acc3997 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:04.481586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 174/333] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:55:04 2022] GET /identity/v3/users/0caf296e87174f9bbea8a10ddaf4bd68 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:04.490904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c296-2450-4694-8d1f-b39d9ac0836e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:04.575966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:04.679321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c296-2450-4694-8d1f-b39d9ac0836e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:04.730358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70991b7b-3d23-4b5b-8f35-318875dabf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:04.730898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70991b7b-3d23-4b5b-8f35-318875dabf0f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:04.731184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70991b7b-3d23-4b5b-8f35-318875dabf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:04.731462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70991b7b-3d23-4b5b-8f35-318875dabf0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:04.732214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70991b7b-3d23-4b5b-8f35-318875dabf0f None admin] RBAC: Adding query filter params (role.id=2db61e25a9cb41608fb5c1dd7983e1d9, user.id=0caf296e87174f9bbea8a10ddaf4bd68, scope.system=all) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:04.732562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70991b7b-3d23-4b5b-8f35-318875dabf0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:04.734014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70991b7b-3d23-4b5b-8f35-318875dabf0f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:04.752863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 160/334] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Aug 31 00:55:04 2022] GET /identity/v3/role_assignments?user.id=0caf296e87174f9bbea8a10ddaf4bd68&scope.system=all&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 510 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:06.015454 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16fc25-81e5-4b3a-a137-d3c6c3d185e5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:06.016865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16fc25-81e5-4b3a-a137-d3c6c3d185e5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:06.017561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16fc25-81e5-4b3a-a137-d3c6c3d185e5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:06.020177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 175/335] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:06.029759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298ad9a-06ea-4f6d-9523-80cd04804cac None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:06.031033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298ad9a-06ea-4f6d-9523-80cd04804cac None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:06.031731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298ad9a-06ea-4f6d-9523-80cd04804cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:06.068889 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0298ad9a-06ea-4f6d-9523-80cd04804cac None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:06.070431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0298ad9a-06ea-4f6d-9523-80cd04804cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:06.096838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458a71a-672e-4c23-8c40-a1cdc7151ece None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:06.097494 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458a71a-672e-4c23-8c40-a1cdc7151ece None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:06.097984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458a71a-672e-4c23-8c40-a1cdc7151ece None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:06.099854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 176/336] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:06.106453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a7861-771d-48af-8c2b-f258537fa2e3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:06.107068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a7861-771d-48af-8c2b-f258537fa2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:06.107568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a7861-771d-48af-8c2b-f258537fa2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:06.134414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-147a7861-771d-48af-8c2b-f258537fa2e3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:06.136020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-147a7861-771d-48af-8c2b-f258537fa2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:06.172998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 161/337] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:06.174624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b471d-55f2-4e45-b549-e3e78b50487e None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:06.175090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b471d-55f2-4e45-b549-e3e78b50487e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:06.175513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b471d-55f2-4e45-b549-e3e78b50487e None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:06.177069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 162/338] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:06.183721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48fef0-15af-4ea4-8fce-bf54e56b024b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:06.184350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48fef0-15af-4ea4-8fce-bf54e56b024b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:06.184850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48fef0-15af-4ea4-8fce-bf54e56b024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:06.227121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-cc48fef0-15af-4ea4-8fce-bf54e56b024b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:06.229335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cc48fef0-15af-4ea4-8fce-bf54e56b024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:06.264966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 177/339] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:06.277756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:06.375251 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 163/340] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:06.615756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a7861-771d-48af-8c2b-f258537fa2e3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:06.706060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48fef0-15af-4ea4-8fce-bf54e56b024b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:06.729113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a7861-771d-48af-8c2b-f258537fa2e3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:06.752682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:06.769162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89cf6e-7091-4a8e-8093-27600a218174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:06.769861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89cf6e-7091-4a8e-8093-27600a218174 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:06.772087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89cf6e-7091-4a8e-8093-27600a218174 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:06.772389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89cf6e-7091-4a8e-8093-27600a218174 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:06.786062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89cf6e-7091-4a8e-8093-27600a218174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2a89cf6e-7091-4a8e-8093-27600a218174 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:06.791852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:06.792771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:06.793630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 178/341] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:55:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:06.798899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89cf6e-7091-4a8e-8093-27600a218174 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:06.915367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89cf6e-7091-4a8e-8093-27600a218174 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:06.959706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3177410-1641-44e4-8104-c2b62c8aef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:06.960457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3177410-1641-44e4-8104-c2b62c8aef14 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:06.960738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3177410-1641-44e4-8104-c2b62c8aef14 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:06.961014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3177410-1641-44e4-8104-c2b62c8aef14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:06.974215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3177410-1641-44e4-8104-c2b62c8aef14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:06.978261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48fef0-15af-4ea4-8fce-bf54e56b024b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c3177410-1641-44e4-8104-c2b62c8aef14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:06.979856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:06.980742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:06.981531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 179/342] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:06.982736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3177410-1641-44e4-8104-c2b62c8aef14 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:07.028134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:07.046542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab3793-00c0-4d26-8c6f-d37e9bf04b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:07.047364 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab3793-00c0-4d26-8c6f-d37e9bf04b17 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:07.047498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab3793-00c0-4d26-8c6f-d37e9bf04b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:07.047821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab3793-00c0-4d26-8c6f-d37e9bf04b17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:07.067912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab3793-00c0-4d26-8c6f-d37e9bf04b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-08ab3793-00c0-4d26-8c6f-d37e9bf04b17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:07.075430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:07.076417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:07.077231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 164/343] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:07.077969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab3793-00c0-4d26-8c6f-d37e9bf04b17 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:07.098988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:07.221808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab3793-00c0-4d26-8c6f-d37e9bf04b17 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:07.224765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3177410-1641-44e4-8104-c2b62c8aef14 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:07.267386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4e2e0-9867-4387-b6d4-3b854617ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:07.268357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4e2e0-9867-4387-b6d4-3b854617ab58 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:07.268849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4e2e0-9867-4387-b6d4-3b854617ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:07.269307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4e2e0-9867-4387-b6d4-3b854617ab58 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:07.270478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4e2e0-9867-4387-b6d4-3b854617ab58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:07.271035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4e2e0-9867-4387-b6d4-3b854617ab58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:07.274171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4e2e0-9867-4387-b6d4-3b854617ab58 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:07.285462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 165/344] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:07.286338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4e2e0-9867-4387-b6d4-3b854617ab58 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:07.297437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808ed32-941c-40da-a3f4-8d68135e836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:07.299075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808ed32-941c-40da-a3f4-8d68135e836a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:07.299876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808ed32-941c-40da-a3f4-8d68135e836a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:07.300673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808ed32-941c-40da-a3f4-8d68135e836a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:07.301981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808ed32-941c-40da-a3f4-8d68135e836a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:07.302678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808ed32-941c-40da-a3f4-8d68135e836a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:07.304509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808ed32-941c-40da-a3f4-8d68135e836a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:07.322606 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 180/345] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:07.324120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808ed32-941c-40da-a3f4-8d68135e836a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:07.374021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:07.402060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4e2e0-9867-4387-b6d4-3b854617ab58 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:07.438793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d3a1d-887f-4cc3-919e-1572438ced3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:07.439698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d3a1d-887f-4cc3-919e-1572438ced3b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:07.440128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d3a1d-887f-4cc3-919e-1572438ced3b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:07.440579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d3a1d-887f-4cc3-919e-1572438ced3b None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:07.441414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d3a1d-887f-4cc3-919e-1572438ced3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:07.441873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d3a1d-887f-4cc3-919e-1572438ced3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:07.443443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d3a1d-887f-4cc3-919e-1572438ced3b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:07.453903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 166/346] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:07.454988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d3a1d-887f-4cc3-919e-1572438ced3b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:07.562678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:07.571245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808ed32-941c-40da-a3f4-8d68135e836a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:07.577520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d3a1d-887f-4cc3-919e-1572438ced3b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:07.614355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85469b-612d-4715-a3f9-08933afe76b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:07.615220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85469b-612d-4715-a3f9-08933afe76b5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:07.615649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85469b-612d-4715-a3f9-08933afe76b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:07.616068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85469b-612d-4715-a3f9-08933afe76b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:07.647284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:07.674111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738af4a-02fb-415a-951a-ff787b087ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:07.674997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738af4a-02fb-415a-951a-ff787b087ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:07.675422 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738af4a-02fb-415a-951a-ff787b087ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:07.675836 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738af4a-02fb-415a-951a-ff787b087ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:07.700359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85469b-612d-4715-a3f9-08933afe76b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:07.702117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85469b-612d-4715-a3f9-08933afe76b5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:07.786764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738af4a-02fb-415a-951a-ff787b087ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:07.789518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738af4a-02fb-415a-951a-ff787b087ac1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:07.844524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 167/347] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:07.845727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85469b-612d-4715-a3f9-08933afe76b5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:07.886355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:07.925502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:07.929969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 181/348] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:07.932307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9e89-beac-4a5b-be3f-d84d14dc426c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:07.932981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9e89-beac-4a5b-be3f-d84d14dc426c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:07.933463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9e89-beac-4a5b-be3f-d84d14dc426c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:07.935389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 182/349] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:07.936437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9e89-beac-4a5b-be3f-d84d14dc426c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:07.984312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85469b-612d-4715-a3f9-08933afe76b5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:08.022641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaa5a2-d2e2-47b4-a524-13829ec19739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:08.023533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa5a2-d2e2-47b4-a524-13829ec19739 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.024673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa5a2-d2e2-47b4-a524-13829ec19739 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.025340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa5a2-d2e2-47b4-a524-13829ec19739 None admin] PATH_INFO: `/v3/users/18ff66052c4e46f0863405bd5c0b0543` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.027577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aaa5a2-d2e2-47b4-a524-13829ec19739 None admin] RBAC: Authorizing `identity:get_user(user_id=18ff66052c4e46f0863405bd5c0b0543)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:08.030311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aaa5a2-d2e2-47b4-a524-13829ec19739 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:08.033211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 168/350] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:55:07 2022] GET /identity/v3/users/18ff66052c4e46f0863405bd5c0b0543 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:08.034922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaa5a2-d2e2-47b4-a524-13829ec19739 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:08.072950 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9e89-beac-4a5b-be3f-d84d14dc426c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:08.114893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e5f79-99d4-4773-8d4d-9278594ae613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:08.115619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e5f79-99d4-4773-8d4d-9278594ae613 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.116140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e5f79-99d4-4773-8d4d-9278594ae613 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.116725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e5f79-99d4-4773-8d4d-9278594ae613 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.118611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e5f79-99d4-4773-8d4d-9278594ae613 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:08.120304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e5f79-99d4-4773-8d4d-9278594ae613 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:08.122456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 183/351] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:07 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:08.124262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d871ac-8d70-4e8e-aff5-3b5a14ff12cf None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.124800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d871ac-8d70-4e8e-aff5-3b5a14ff12cf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.125276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d871ac-8d70-4e8e-aff5-3b5a14ff12cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.156834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-84d871ac-8d70-4e8e-aff5-3b5a14ff12cf None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:08.158262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-84d871ac-8d70-4e8e-aff5-3b5a14ff12cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:08.175444 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaa5a2-d2e2-47b4-a524-13829ec19739 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:08.181178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:08.227763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc4920-437f-4327-86e6-2d279ff7aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:08.228749 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4920-437f-4327-86e6-2d279ff7aa6e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.229225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4920-437f-4327-86e6-2d279ff7aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.229669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4920-437f-4327-86e6-2d279ff7aa6e None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.231098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc4920-437f-4327-86e6-2d279ff7aa6e None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:08.232793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc4920-437f-4327-86e6-2d279ff7aa6e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:08.234722 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 169/352] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:08 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:08.240304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc4920-437f-4327-86e6-2d279ff7aa6e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:08.242477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:08.248908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 184/353] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:08.256370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d871ac-8d70-4e8e-aff5-3b5a14ff12cf None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:08.377001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d871ac-8d70-4e8e-aff5-3b5a14ff12cf None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:08.420310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f1ece-a254-4dd0-935b-85fa3ad00f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:08.420310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1ece-a254-4dd0-935b-85fa3ad00f96 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.420310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1ece-a254-4dd0-935b-85fa3ad00f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.420310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1ece-a254-4dd0-935b-85fa3ad00f96 None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.428486 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f1ece-a254-4dd0-935b-85fa3ad00f96 None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:08.430725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f1ece-a254-4dd0-935b-85fa3ad00f96 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:08.432368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc4920-437f-4327-86e6-2d279ff7aa6e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:08.438692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 185/354] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:08 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:08.438692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f1ece-a254-4dd0-935b-85fa3ad00f96 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:08.483055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050a2a2-de6c-46c9-9816-776a0bb4203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:08.484041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a2a2-de6c-46c9-9816-776a0bb4203c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.484559 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a2a2-de6c-46c9-9816-776a0bb4203c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.485083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a2a2-de6c-46c9-9816-776a0bb4203c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.486024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a2a2-de6c-46c9-9816-776a0bb4203c None admin] RBAC: Adding query filter params (role.id=15e6445cc58a46448b7b3bdff71f24d8, user.id=18ff66052c4e46f0863405bd5c0b0543, scope.system=all) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:08.486599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a2a2-de6c-46c9-9816-776a0bb4203c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:08.488312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a2a2-de6c-46c9-9816-776a0bb4203c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:08.507552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 170/355] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Aug 31 00:55:08 2022] GET /identity/v3/role_assignments?user.id=18ff66052c4e46f0863405bd5c0b0543&scope.system=all&role.id=15e6445cc58a46448b7b3bdff71f24d8 => generated 510 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:08.509253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050a2a2-de6c-46c9-9816-776a0bb4203c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:08.514362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:08.547019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:08.566813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f1ece-a254-4dd0-935b-85fa3ad00f96 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:08.611857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69e422-3bb6-4cc8-844f-b219cca2e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:08.612963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69e422-3bb6-4cc8-844f-b219cca2e07d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.613078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69e422-3bb6-4cc8-844f-b219cca2e07d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.613308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69e422-3bb6-4cc8-844f-b219cca2e07d None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.614569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69e422-3bb6-4cc8-844f-b219cca2e07d None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:08.616054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69e422-3bb6-4cc8-844f-b219cca2e07d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:08.622862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 186/356] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:08 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:08.622862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485069f-5dc3-4859-b19f-3108ea74c6da None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.622862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485069f-5dc3-4859-b19f-3108ea74c6da None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.622862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485069f-5dc3-4859-b19f-3108ea74c6da None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.622862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 187/357] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:08.628531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a52883-e0a0-4524-84eb-3e644bd20511 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.628829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a52883-e0a0-4524-84eb-3e644bd20511 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.629023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a52883-e0a0-4524-84eb-3e644bd20511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.647980 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050a2a2-de6c-46c9-9816-776a0bb4203c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:08.653705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e1a52883-e0a0-4524-84eb-3e644bd20511 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:08.655169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e1a52883-e0a0-4524-84eb-3e644bd20511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:08.690480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3394036-b555-4f01-af2b-d6afb0304298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:08.691508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3394036-b555-4f01-af2b-d6afb0304298 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.691992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3394036-b555-4f01-af2b-d6afb0304298 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.692500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3394036-b555-4f01-af2b-d6afb0304298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.693488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3394036-b555-4f01-af2b-d6afb0304298 None admin] RBAC: Adding query filter params (group.id=446d8bcaa1494ca89bc494ceadc81b8d, role.id=5923fa436ead4ac4b096b40af8672f94, scope.project.id=63e130b98cab47d38aafc327c5475d29) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:08.694014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3394036-b555-4f01-af2b-d6afb0304298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:08.696303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3394036-b555-4f01-af2b-d6afb0304298 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:08.702960 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 171/358] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Aug 31 00:55:08 2022] GET /identity/v3/role_assignments?group.id=446d8bcaa1494ca89bc494ceadc81b8d&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=5923fa436ead4ac4b096b40af8672f94 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:08.704204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3394036-b555-4f01-af2b-d6afb0304298 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:08.750569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 188/359] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:08.751884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc019cb8-8f44-4397-977b-3e813f769337 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.752175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc019cb8-8f44-4397-977b-3e813f769337 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.753433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc019cb8-8f44-4397-977b-3e813f769337 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.755136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 189/360] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:08.760801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88cc4f-f02c-41e1-8064-a9281db011e2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.761097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88cc4f-f02c-41e1-8064-a9281db011e2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.761373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88cc4f-f02c-41e1-8064-a9281db011e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.784026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3a88cc4f-f02c-41e1-8064-a9281db011e2 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:08.785401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3a88cc4f-f02c-41e1-8064-a9281db011e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:08.842293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:08.850278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3394036-b555-4f01-af2b-d6afb0304298 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:08.907921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801e4cd-9b36-4403-be47-d2b563d9dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:08.908955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e4cd-9b36-4403-be47-d2b563d9dc8e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:08.909438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e4cd-9b36-4403-be47-d2b563d9dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:08.909907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e4cd-9b36-4403-be47-d2b563d9dc8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:08.910880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801e4cd-9b36-4403-be47-d2b563d9dc8e None admin] RBAC: Adding query filter params (group.id=446d8bcaa1494ca89bc494ceadc81b8d, role.id=2db61e25a9cb41608fb5c1dd7983e1d9, scope.project.id=63e130b98cab47d38aafc327c5475d29) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:08.911534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:08.911933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801e4cd-9b36-4403-be47-d2b563d9dc8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:08.914000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801e4cd-9b36-4403-be47-d2b563d9dc8e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:08.923066 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 172/361] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Aug 31 00:55:08 2022] GET /identity/v3/role_assignments?group.id=446d8bcaa1494ca89bc494ceadc81b8d&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:08.926798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801e4cd-9b36-4403-be47-d2b563d9dc8e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:08.950447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 190/362] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:09.079782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801e4cd-9b36-4403-be47-d2b563d9dc8e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:09.139616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dc137-8a3f-4030-bc8e-80d3a5e54fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:09.140268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dc137-8a3f-4030-bc8e-80d3a5e54fda None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:09.140589 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dc137-8a3f-4030-bc8e-80d3a5e54fda None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:09.140935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dc137-8a3f-4030-bc8e-80d3a5e54fda None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:09.163189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4dc137-8a3f-4030-bc8e-80d3a5e54fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-3b4dc137-8a3f-4030-bc8e-80d3a5e54fda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:09.169113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:09.170047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:09.170827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 173/363] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:09.181677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88cc4f-f02c-41e1-8064-a9281db011e2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:09.205816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dc137-8a3f-4030-bc8e-80d3a5e54fda None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:09.231262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:09.344674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88cc4f-f02c-41e1-8064-a9281db011e2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:09.371637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dc137-8a3f-4030-bc8e-80d3a5e54fda None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:09.404959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac468e37-d525-46f4-8c8f-2d3e83268155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:09.405601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac468e37-d525-46f4-8c8f-2d3e83268155 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:09.405885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac468e37-d525-46f4-8c8f-2d3e83268155 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:09.406163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac468e37-d525-46f4-8c8f-2d3e83268155 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:09.406847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac468e37-d525-46f4-8c8f-2d3e83268155 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:09.407153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac468e37-d525-46f4-8c8f-2d3e83268155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:09.410631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac468e37-d525-46f4-8c8f-2d3e83268155 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:09.427478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 191/364] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:09.427478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac468e37-d525-46f4-8c8f-2d3e83268155 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:09.447979 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84454280-2a48-414f-859c-3a3551c75014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:09.448666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84454280-2a48-414f-859c-3a3551c75014 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:09.448944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84454280-2a48-414f-859c-3a3551c75014 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:09.449217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84454280-2a48-414f-859c-3a3551c75014 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:09.462867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84454280-2a48-414f-859c-3a3551c75014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-84454280-2a48-414f-859c-3a3551c75014 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:09.470688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:09.471640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:09.472482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 174/365] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:55:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:09.473142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84454280-2a48-414f-859c-3a3551c75014 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:09.516813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:09.586885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac468e37-d525-46f4-8c8f-2d3e83268155 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:09.610448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:09.644948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84454280-2a48-414f-859c-3a3551c75014 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:09.661914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd303fba-df35-44c1-bf2b-a9f9302a794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:09.662621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd303fba-df35-44c1-bf2b-a9f9302a794c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:09.663939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd303fba-df35-44c1-bf2b-a9f9302a794c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:09.663939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd303fba-df35-44c1-bf2b-a9f9302a794c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:09.690658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd303fba-df35-44c1-bf2b-a9f9302a794c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cd303fba-df35-44c1-bf2b-a9f9302a794c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:09.701159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:09.702095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:09.702895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 192/366] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:55:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:09.705670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd303fba-df35-44c1-bf2b-a9f9302a794c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:09.707154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40acc0-4d4c-4e2c-a6a1-f41857e59ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:09.708053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40acc0-4d4c-4e2c-a6a1-f41857e59ead None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:09.708612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40acc0-4d4c-4e2c-a6a1-f41857e59ead None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:09.709087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40acc0-4d4c-4e2c-a6a1-f41857e59ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:09.800470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40acc0-4d4c-4e2c-a6a1-f41857e59ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:09.802531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40acc0-4d4c-4e2c-a6a1-f41857e59ead None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:09.877608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd303fba-df35-44c1-bf2b-a9f9302a794c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:09.898365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:09.928265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:09.942638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9df6-9e93-4ef7-b560-1916eac6e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:09.943193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9df6-9e93-4ef7-b560-1916eac6e646 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:09.943477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9df6-9e93-4ef7-b560-1916eac6e646 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:09.943753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9df6-9e93-4ef7-b560-1916eac6e646 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:09.944467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b9df6-9e93-4ef7-b560-1916eac6e646 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:09.944777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b9df6-9e93-4ef7-b560-1916eac6e646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:09.946401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b9df6-9e93-4ef7-b560-1916eac6e646 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:09.957158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 193/367] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:09.958102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9df6-9e93-4ef7-b560-1916eac6e646 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:09.967788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 175/368] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:09.969088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40acc0-4d4c-4e2c-a6a1-f41857e59ead None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:10.085142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40acc0-4d4c-4e2c-a6a1-f41857e59ead None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:10.101260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9df6-9e93-4ef7-b560-1916eac6e646 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:10.131140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb4f6b-efce-4e8a-8e74-6134dc50abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:10.132153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4f6b-efce-4e8a-8e74-6134dc50abf7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:10.132677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4f6b-efce-4e8a-8e74-6134dc50abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:10.133555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4f6b-efce-4e8a-8e74-6134dc50abf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:10.157421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11453cda-5dbd-4ce7-a414-a0775ff76d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:10.158652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453cda-5dbd-4ce7-a414-a0775ff76d26 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:10.158846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453cda-5dbd-4ce7-a414-a0775ff76d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:10.159249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453cda-5dbd-4ce7-a414-a0775ff76d26 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:10.161668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11453cda-5dbd-4ce7-a414-a0775ff76d26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:10.162240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11453cda-5dbd-4ce7-a414-a0775ff76d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:10.165122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11453cda-5dbd-4ce7-a414-a0775ff76d26 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:10.184351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 194/369] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:10.184351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11453cda-5dbd-4ce7-a414-a0775ff76d26 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:10.199183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:10.236730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb4f6b-efce-4e8a-8e74-6134dc50abf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:10.239243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb4f6b-efce-4e8a-8e74-6134dc50abf7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:10.250058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:10.350956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11453cda-5dbd-4ce7-a414-a0775ff76d26 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:10.360721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 176/370] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:10.362122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb4f6b-efce-4e8a-8e74-6134dc50abf7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:10.393326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b113b1-660a-4d23-8081-107adc9e272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:10.393917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b113b1-660a-4d23-8081-107adc9e272d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:10.394208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b113b1-660a-4d23-8081-107adc9e272d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:10.394489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b113b1-660a-4d23-8081-107adc9e272d None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:10.395773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b113b1-660a-4d23-8081-107adc9e272d None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:10.397444 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b113b1-660a-4d23-8081-107adc9e272d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:10.400069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 195/371] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:10 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:10.401228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b113b1-660a-4d23-8081-107adc9e272d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:10.455427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:10.481241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb4f6b-efce-4e8a-8e74-6134dc50abf7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:10.523184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34953b4f-1771-4668-9407-7822dab1fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:10.525228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953b4f-1771-4668-9407-7822dab1fd21 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:10.525768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953b4f-1771-4668-9407-7822dab1fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:10.525963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b113b1-660a-4d23-8081-107adc9e272d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:10.526449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953b4f-1771-4668-9407-7822dab1fd21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:10.528881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:10.576633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115e7c5-0b72-4f46-b152-f997f8efea0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:10.577292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115e7c5-0b72-4f46-b152-f997f8efea0c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:10.577579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115e7c5-0b72-4f46-b152-f997f8efea0c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:10.577859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115e7c5-0b72-4f46-b152-f997f8efea0c None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:10.579030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115e7c5-0b72-4f46-b152-f997f8efea0c None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:10.580542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115e7c5-0b72-4f46-b152-f997f8efea0c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:10.582347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 196/372] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:10 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:10.583069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115e7c5-0b72-4f46-b152-f997f8efea0c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:10.616634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34953b4f-1771-4668-9407-7822dab1fd21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:10.619668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34953b4f-1771-4668-9407-7822dab1fd21 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:10.702275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115e7c5-0b72-4f46-b152-f997f8efea0c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:10.715685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:10.741767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 177/373] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:10.743996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34953b4f-1771-4668-9407-7822dab1fd21 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:10.745504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d664bc7-b739-411c-a83b-fdfb5927cd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:10.746167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d664bc7-b739-411c-a83b-fdfb5927cd82 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:10.746451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d664bc7-b739-411c-a83b-fdfb5927cd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:10.746730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d664bc7-b739-411c-a83b-fdfb5927cd82 None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:10.748002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d664bc7-b739-411c-a83b-fdfb5927cd82 None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:10.749661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d664bc7-b739-411c-a83b-fdfb5927cd82 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:10.751188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 197/374] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:10 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:10.751962 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d664bc7-b739-411c-a83b-fdfb5927cd82 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:10.801591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:10.894914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d664bc7-b739-411c-a83b-fdfb5927cd82 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:10.902762 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34953b4f-1771-4668-9407-7822dab1fd21 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:10.950021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ce81-df64-43f3-8f2d-e1ac9f37a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:10.950738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ce81-df64-43f3-8f2d-e1ac9f37a3ea None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:10.951021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ce81-df64-43f3-8f2d-e1ac9f37a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:10.951355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ce81-df64-43f3-8f2d-e1ac9f37a3ea None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:10.954551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205ce81-df64-43f3-8f2d-e1ac9f37a3ea None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:10.956059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205ce81-df64-43f3-8f2d-e1ac9f37a3ea None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:10.956304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd31675-da02-4b39-af60-fd7eaf36d430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:10.957230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31675-da02-4b39-af60-fd7eaf36d430 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:10.957721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31675-da02-4b39-af60-fd7eaf36d430 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:10.958068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 178/375] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:10 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:10.958475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31675-da02-4b39-af60-fd7eaf36d430 None admin] PATH_INFO: `/v3/projects/945912bdd11549de9a3f98d9095b0494` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:10.958859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ce81-df64-43f3-8f2d-e1ac9f37a3ea None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:10.960135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd31675-da02-4b39-af60-fd7eaf36d430 None admin] RBAC: Authorizing `identity:get_project(project_id=945912bdd11549de9a3f98d9095b0494)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:10.962395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd31675-da02-4b39-af60-fd7eaf36d430 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:10.964445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 198/376] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:10 2022] GET /identity/v3/projects/945912bdd11549de9a3f98d9095b0494 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:10.968421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd31675-da02-4b39-af60-fd7eaf36d430 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:11.045539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:11.140154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ce81-df64-43f3-8f2d-e1ac9f37a3ea None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:11.144395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd31675-da02-4b39-af60-fd7eaf36d430 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:11.155681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:11.186926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62b7c-ad6e-4885-849a-a8ff103be7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:11.188469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62b7c-ad6e-4885-849a-a8ff103be7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:11.188772 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62b7c-ad6e-4885-849a-a8ff103be7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:11.189056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62b7c-ad6e-4885-849a-a8ff103be7a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:11.189807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb62b7c-ad6e-4885-849a-a8ff103be7a3 None admin] RBAC: Adding query filter params (group.id=446d8bcaa1494ca89bc494ceadc81b8d, role.id=5923fa436ead4ac4b096b40af8672f94, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:11.190124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb62b7c-ad6e-4885-849a-a8ff103be7a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:11.191586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb62b7c-ad6e-4885-849a-a8ff103be7a3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:11.192043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44615b73-947d-4b4a-b598-192eca810337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:11.192928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615b73-947d-4b4a-b598-192eca810337 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:11.193426 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615b73-947d-4b4a-b598-192eca810337 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:11.193906 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615b73-947d-4b4a-b598-192eca810337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:11.194891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615b73-947d-4b4a-b598-192eca810337 None admin] RBAC: Adding query filter params (group.id=446d8bcaa1494ca89bc494ceadc81b8d, role.id=2db61e25a9cb41608fb5c1dd7983e1d9, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:11.195458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615b73-947d-4b4a-b598-192eca810337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:11.201864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 199/377] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Aug 31 00:55:10 2022] GET /identity/v3/role_assignments?group.id=446d8bcaa1494ca89bc494ceadc81b8d&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=5923fa436ead4ac4b096b40af8672f94 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:11.201864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62b7c-ad6e-4885-849a-a8ff103be7a3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:11.203499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615b73-947d-4b4a-b598-192eca810337 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:11.217654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 179/378] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Aug 31 00:55:10 2022] GET /identity/v3/role_assignments?group.id=446d8bcaa1494ca89bc494ceadc81b8d&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:11.300748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b9ea1-f560-44c2-88d6-8b9048126460 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:11.302071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b9ea1-f560-44c2-88d6-8b9048126460 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:11.302713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b9ea1-f560-44c2-88d6-8b9048126460 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:11.305420 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 180/379] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:11.313515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d602e0e-9275-40fc-a6d5-475a29b3f0ca None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:11.314179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d602e0e-9275-40fc-a6d5-475a29b3f0ca None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:11.314692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d602e0e-9275-40fc-a6d5-475a29b3f0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:11.326761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62b7c-ad6e-4885-849a-a8ff103be7a3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:11.355679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9d602e0e-9275-40fc-a6d5-475a29b3f0ca None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:11.365048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9d602e0e-9275-40fc-a6d5-475a29b3f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:11.371910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da049f35-2968-4caa-992b-138c6f060639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:11.374222 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da049f35-2968-4caa-992b-138c6f060639 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:11.378655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da049f35-2968-4caa-992b-138c6f060639 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:11.379293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da049f35-2968-4caa-992b-138c6f060639 None admin] PATH_INFO: `/v3/groups/f1124407958d49ffa4a725ffc9fb039e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:11.393908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da049f35-2968-4caa-992b-138c6f060639 None admin] RBAC: Authorizing `identity:get_group(group_id=f1124407958d49ffa4a725ffc9fb039e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:11.397300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da049f35-2968-4caa-992b-138c6f060639 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:11.404869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 200/380] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:11 2022] GET /identity/v3/groups/f1124407958d49ffa4a725ffc9fb039e => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:11.412173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da049f35-2968-4caa-992b-138c6f060639 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:11.491191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:11.527666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 181/381] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:11.583152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235aefa-f243-4926-800f-cb544ca0f0e8 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:11.583468 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235aefa-f243-4926-800f-cb544ca0f0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:11.583683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235aefa-f243-4926-800f-cb544ca0f0e8 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:11.585673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 182/382] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:11.592220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b886-82d3-413b-ab0f-9ca92fcf07f5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:11.592877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b886-82d3-413b-ab0f-9ca92fcf07f5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:11.593380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b886-82d3-413b-ab0f-9ca92fcf07f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:11.631426 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f585b886-82d3-413b-ab0f-9ca92fcf07f5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:11.631426 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f585b886-82d3-413b-ab0f-9ca92fcf07f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:11.673984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da049f35-2968-4caa-992b-138c6f060639 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:11.708278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:11.745367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b0bf3-d303-4d01-ab03-a556e409d6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:11.746282 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b0bf3-d303-4d01-ab03-a556e409d6ff None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:11.746837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b0bf3-d303-4d01-ab03-a556e409d6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:11.747261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b0bf3-d303-4d01-ab03-a556e409d6ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:11.748567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b0bf3-d303-4d01-ab03-a556e409d6ff None admin] RBAC: Adding query filter params (group.id=f1124407958d49ffa4a725ffc9fb039e, role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=945912bdd11549de9a3f98d9095b0494) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:11.749077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b0bf3-d303-4d01-ab03-a556e409d6ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:11.751590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b0bf3-d303-4d01-ab03-a556e409d6ff None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:11.752422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 183/383] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:11.765309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 201/384] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Aug 31 00:55:11 2022] GET /identity/v3/role_assignments?group.id=f1124407958d49ffa4a725ffc9fb039e&scope.project.id=945912bdd11549de9a3f98d9095b0494&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 260 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:11.863413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585b886-82d3-413b-ab0f-9ca92fcf07f5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:11.984577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585b886-82d3-413b-ab0f-9ca92fcf07f5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:12.027070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2a97a-010e-4f3a-8547-973e820d4f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:12.027731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2a97a-010e-4f3a-8547-973e820d4f79 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:12.028014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2a97a-010e-4f3a-8547-973e820d4f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:12.028293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2a97a-010e-4f3a-8547-973e820d4f79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:12.041424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2a97a-010e-4f3a-8547-973e820d4f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-cff2a97a-010e-4f3a-8547-973e820d4f79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:12.046378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:12.047314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:12.048171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 184/385] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:55:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:12.053794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b0bf3-d303-4d01-ab03-a556e409d6ff None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:12.127877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2a97a-010e-4f3a-8547-973e820d4f79 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:12.189539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:12.194328 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b0bf3-d303-4d01-ab03-a556e409d6ff None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:12.226417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:12.248975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b39db-2525-4cad-ad62-c18957005878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:12.249370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b39db-2525-4cad-ad62-c18957005878 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:12.250420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b39db-2525-4cad-ad62-c18957005878 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:12.250714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b39db-2525-4cad-ad62-c18957005878 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:12.251542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b39db-2525-4cad-ad62-c18957005878 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:12.251862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b39db-2525-4cad-ad62-c18957005878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:12.255826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b39db-2525-4cad-ad62-c18957005878 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:12.271280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 202/386] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:12.278134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b39db-2525-4cad-ad62-c18957005878 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:12.371553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2a97a-010e-4f3a-8547-973e820d4f79 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:12.430664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8b43d-d55b-416b-88f9-4c641f00b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:12.431807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8b43d-d55b-416b-88f9-4c641f00b14b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:12.432098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8b43d-d55b-416b-88f9-4c641f00b14b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:12.432407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8b43d-d55b-416b-88f9-4c641f00b14b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:12.444493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8b43d-d55b-416b-88f9-4c641f00b14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-35f8b43d-d55b-416b-88f9-4c641f00b14b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:12.450556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:12.451469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:12.452564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 185/387] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:12.460386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8b43d-d55b-416b-88f9-4c641f00b14b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:12.498164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b39db-2525-4cad-ad62-c18957005878 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:12.553165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d9cc1-c5dd-470c-a127-12d0fe9d1ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:12.553830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9cc1-c5dd-470c-a127-12d0fe9d1ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:12.554115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9cc1-c5dd-470c-a127-12d0fe9d1ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:12.554392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9cc1-c5dd-470c-a127-12d0fe9d1ec3 None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:12.555675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d9cc1-c5dd-470c-a127-12d0fe9d1ec3 None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:12.557245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d9cc1-c5dd-470c-a127-12d0fe9d1ec3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:12.559189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 203/388] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:12 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:12.564683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d9cc1-c5dd-470c-a127-12d0fe9d1ec3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:12.578605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:12.599851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8b43d-d55b-416b-88f9-4c641f00b14b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:12.607090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:12.666436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5eca2b-18cd-4fad-ae53-dd9a3320600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:12.667631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5eca2b-18cd-4fad-ae53-dd9a3320600c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:12.668091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5eca2b-18cd-4fad-ae53-dd9a3320600c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:12.668593 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5eca2b-18cd-4fad-ae53-dd9a3320600c None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:12.669734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5eca2b-18cd-4fad-ae53-dd9a3320600c None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:12.670289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5eca2b-18cd-4fad-ae53-dd9a3320600c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:12.672815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5eca2b-18cd-4fad-ae53-dd9a3320600c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:12.689395 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 186/389] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:12.698320 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5eca2b-18cd-4fad-ae53-dd9a3320600c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:12.820384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d9cc1-c5dd-470c-a127-12d0fe9d1ec3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:12.907855 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5eca2b-18cd-4fad-ae53-dd9a3320600c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:12.934401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789d715-b6cc-4df2-84df-9a4bf119708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:12.936355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d715-b6cc-4df2-84df-9a4bf119708e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:12.936355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d715-b6cc-4df2-84df-9a4bf119708e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:12.936355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d715-b6cc-4df2-84df-9a4bf119708e None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:12.941317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789d715-b6cc-4df2-84df-9a4bf119708e None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:12.943362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789d715-b6cc-4df2-84df-9a4bf119708e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:12.949544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 204/390] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:12 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:12.956854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789d715-b6cc-4df2-84df-9a4bf119708e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:12.999930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a52c6-9fa0-4a54-b6f5-95c8b5cf8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:13.002076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a52c6-9fa0-4a54-b6f5-95c8b5cf8366 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:13.002392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a52c6-9fa0-4a54-b6f5-95c8b5cf8366 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:13.002671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a52c6-9fa0-4a54-b6f5-95c8b5cf8366 None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:13.003900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a52c6-9fa0-4a54-b6f5-95c8b5cf8366 None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:13.007201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a52c6-9fa0-4a54-b6f5-95c8b5cf8366 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:13.009955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 187/391] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:12 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:13.020795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a52c6-9fa0-4a54-b6f5-95c8b5cf8366 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:13.083136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:13.120523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:13.132402 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789d715-b6cc-4df2-84df-9a4bf119708e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:13.269399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3573b4-e021-4b0c-9dcf-40229be9cc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:13.270551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3573b4-e021-4b0c-9dcf-40229be9cc15 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:13.270841 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3573b4-e021-4b0c-9dcf-40229be9cc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:13.271120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3573b4-e021-4b0c-9dcf-40229be9cc15 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29/groups/446d8bcaa1494ca89bc494ceadc81b8d/roles/5923fa436ead4ac4b096b40af8672f94` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:13.277742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3573b4-e021-4b0c-9dcf-40229be9cc15 None admin] RBAC: Authorizing `identity:create_grant(project_id=63e130b98cab47d38aafc327c5475d29, group_id=446d8bcaa1494ca89bc494ceadc81b8d, role_id=5923fa436ead4ac4b096b40af8672f94)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:13.277742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3573b4-e021-4b0c-9dcf-40229be9cc15 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:13.301335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a52c6-9fa0-4a54-b6f5-95c8b5cf8366 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:13.324432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 205/392] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Aug 31 00:55:12 2022] PUT /identity/v3/projects/63e130b98cab47d38aafc327c5475d29/groups/446d8bcaa1494ca89bc494ceadc81b8d/roles/5923fa436ead4ac4b096b40af8672f94 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:55:13.365570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab1dc0-a67c-41e4-9075-9b3840bb7429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:13.367099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1dc0-a67c-41e4-9075-9b3840bb7429 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:13.368513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1dc0-a67c-41e4-9075-9b3840bb7429 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:13.369282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1dc0-a67c-41e4-9075-9b3840bb7429 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:13.371762 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab1dc0-a67c-41e4-9075-9b3840bb7429 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:13.375240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab1dc0-a67c-41e4-9075-9b3840bb7429 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:13.379104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 188/393] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:13 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:13.385842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3573b4-e021-4b0c-9dcf-40229be9cc15 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:13.574974 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3573b4-e021-4b0c-9dcf-40229be9cc15 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:13.616459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0d9bf-ce4c-45b3-bca1-fe2587f9f31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:13.617148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0d9bf-ce4c-45b3-bca1-fe2587f9f31a None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:13.617458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0d9bf-ce4c-45b3-bca1-fe2587f9f31a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:13.617736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0d9bf-ce4c-45b3-bca1-fe2587f9f31a None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29/groups/446d8bcaa1494ca89bc494ceadc81b8d/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:13.619778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0d9bf-ce4c-45b3-bca1-fe2587f9f31a None admin] RBAC: Authorizing `identity:create_grant(project_id=63e130b98cab47d38aafc327c5475d29, group_id=446d8bcaa1494ca89bc494ceadc81b8d, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:13.621317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0d9bf-ce4c-45b3-bca1-fe2587f9f31a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:13.641434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 206/394] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Aug 31 00:55:13 2022] PUT /identity/v3/projects/63e130b98cab47d38aafc327c5475d29/groups/446d8bcaa1494ca89bc494ceadc81b8d/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:55:14.096588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000199f8-1320-4f26-8e65-28efee03230e None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:14.096949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000199f8-1320-4f26-8e65-28efee03230e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:14.097221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000199f8-1320-4f26-8e65-28efee03230e None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:14.098849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 189/395] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:14.106730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54878c-e19e-4679-8578-9f9cf79e7b36 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:14.107072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54878c-e19e-4679-8578-9f9cf79e7b36 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:14.107309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54878c-e19e-4679-8578-9f9cf79e7b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:14.129773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0f54878c-e19e-4679-8578-9f9cf79e7b36 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:14.137175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0f54878c-e19e-4679-8578-9f9cf79e7b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:14.159657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:14.266395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 207/396] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:14.400918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5906-b482-4730-a929-6dc4c82d9e04 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:14.401457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5906-b482-4730-a929-6dc4c82d9e04 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:14.401900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5906-b482-4730-a929-6dc4c82d9e04 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:14.404816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 190/397] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:14.410461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb843-a7b6-4c5c-bc71-6fe6321c8cfc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:14.410937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb843-a7b6-4c5c-bc71-6fe6321c8cfc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:14.411022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb843-a7b6-4c5c-bc71-6fe6321c8cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:14.443817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-30abb843-a7b6-4c5c-bc71-6fe6321c8cfc None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:14.445090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-30abb843-a7b6-4c5c-bc71-6fe6321c8cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:14.530995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 208/398] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:14.683095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f091ec1-989c-4c32-81a2-0494d40ddfd0 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:14.683405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f091ec1-989c-4c32-81a2-0494d40ddfd0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:14.683578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f091ec1-989c-4c32-81a2-0494d40ddfd0 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:14.685250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 191/399] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:14.694436 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927473-c5b6-4fda-b5b8-7c197288fd50 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:14.694883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927473-c5b6-4fda-b5b8-7c197288fd50 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:14.695882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927473-c5b6-4fda-b5b8-7c197288fd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:14.728382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-22927473-c5b6-4fda-b5b8-7c197288fd50 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:14.729391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f091ec1-989c-4c32-81a2-0494d40ddfd0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:14.729670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-22927473-c5b6-4fda-b5b8-7c197288fd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:14.859267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 209/400] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:14.920733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:14.926320 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f091ec1-989c-4c32-81a2-0494d40ddfd0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:14.965776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927473-c5b6-4fda-b5b8-7c197288fd50 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:14.986952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:14.988970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c19cc-71d1-4b84-b679-f599030ff9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:14.989630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c19cc-71d1-4b84-b679-f599030ff9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:14.990052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c19cc-71d1-4b84-b679-f599030ff9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:14.990369 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c19cc-71d1-4b84-b679-f599030ff9f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:15.016286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c19cc-71d1-4b84-b679-f599030ff9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-263c19cc-71d1-4b84-b679-f599030ff9f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:15.025917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:15.026872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:15.027657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:15.034301 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 192/401] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:15.036799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c19cc-71d1-4b84-b679-f599030ff9f9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:15.170998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927473-c5b6-4fda-b5b8-7c197288fd50 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:15.172776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c19cc-71d1-4b84-b679-f599030ff9f9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:15.221478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f68aab-870f-45fc-8517-d62978b6e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:15.223153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786f643-7c50-48c9-b260-99ee51edc387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:15.224272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786f643-7c50-48c9-b260-99ee51edc387 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:15.224780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786f643-7c50-48c9-b260-99ee51edc387 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:15.225228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786f643-7c50-48c9-b260-99ee51edc387 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:15.226351 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f68aab-870f-45fc-8517-d62978b6e308 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:15.226842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f68aab-870f-45fc-8517-d62978b6e308 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:15.227295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f68aab-870f-45fc-8517-d62978b6e308 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:15.228544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f68aab-870f-45fc-8517-d62978b6e308 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:15.228870 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f68aab-870f-45fc-8517-d62978b6e308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:15.230279 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f68aab-870f-45fc-8517-d62978b6e308 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:15.250763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786f643-7c50-48c9-b260-99ee51edc387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:15.254639 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 193/402] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d786f643-7c50-48c9-b260-99ee51edc387 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:15.260183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:15.261132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:15.261922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:15.263196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 210/403] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:55:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:15.264400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f68aab-870f-45fc-8517-d62978b6e308 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:15.268535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786f643-7c50-48c9-b260-99ee51edc387 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:15.296212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:15.384556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:15.416756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f68aab-870f-45fc-8517-d62978b6e308 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:15.422378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786f643-7c50-48c9-b260-99ee51edc387 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:15.454574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc55c81-598a-4b91-95ff-2b649911c0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:15.455460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc55c81-598a-4b91-95ff-2b649911c0ba None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:15.455908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc55c81-598a-4b91-95ff-2b649911c0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:15.456366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc55c81-598a-4b91-95ff-2b649911c0ba None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:15.457707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc55c81-598a-4b91-95ff-2b649911c0ba None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:15.459312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc55c81-598a-4b91-95ff-2b649911c0ba None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:15.461151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 194/404] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:15 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:15.461285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5003e-4047-4832-9545-4c934c730c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:15.464476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5003e-4047-4832-9545-4c934c730c6c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:15.464476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5003e-4047-4832-9545-4c934c730c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:15.464476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5003e-4047-4832-9545-4c934c730c6c None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:15.464476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5003e-4047-4832-9545-4c934c730c6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:15.464476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5003e-4047-4832-9545-4c934c730c6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:15.465302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5003e-4047-4832-9545-4c934c730c6c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:15.466847 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc55c81-598a-4b91-95ff-2b649911c0ba None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:15.475426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 211/405] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:15.477347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5003e-4047-4832-9545-4c934c730c6c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:15.555980 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:15.580276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc55c81-598a-4b91-95ff-2b649911c0ba None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:15.599181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5003e-4047-4832-9545-4c934c730c6c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:15.626338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c59c68-613a-442b-a7b0-3a3bd5df08cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:15.627154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c59c68-613a-442b-a7b0-3a3bd5df08cc None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:15.627445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c59c68-613a-442b-a7b0-3a3bd5df08cc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:15.627723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c59c68-613a-442b-a7b0-3a3bd5df08cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:15.637228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:15.640917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88583bd3-e964-454b-87d7-6f76a87e353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:15.641788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88583bd3-e964-454b-87d7-6f76a87e353b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:15.642390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88583bd3-e964-454b-87d7-6f76a87e353b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:15.642491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c59c68-613a-442b-a7b0-3a3bd5df08cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:15.642885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88583bd3-e964-454b-87d7-6f76a87e353b None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:15.644431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88583bd3-e964-454b-87d7-6f76a87e353b None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:15.646079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88583bd3-e964-454b-87d7-6f76a87e353b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c8c59c68-613a-442b-a7b0-3a3bd5df08cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:15.647714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:15.648919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:15.650459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:15.652622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 212/407] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:15 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:15.653299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 195/407] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:55:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:15.654233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88583bd3-e964-454b-87d7-6f76a87e353b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:15.656983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c59c68-613a-442b-a7b0-3a3bd5df08cc None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:15.772037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c59c68-613a-442b-a7b0-3a3bd5df08cc None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:15.788212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88583bd3-e964-454b-87d7-6f76a87e353b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:15.810006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554404b9-c531-4fa7-b8e2-fe53c312b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:15.811062 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554404b9-c531-4fa7-b8e2-fe53c312b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:15.811521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554404b9-c531-4fa7-b8e2-fe53c312b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:15.811987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554404b9-c531-4fa7-b8e2-fe53c312b0a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:15.812878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554404b9-c531-4fa7-b8e2-fe53c312b0a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:15.813406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554404b9-c531-4fa7-b8e2-fe53c312b0a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:15.815093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554404b9-c531-4fa7-b8e2-fe53c312b0a5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:15.821819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:15.825826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9230e9-f4c3-4b88-b615-a21cc8196645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:15.826476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9230e9-f4c3-4b88-b615-a21cc8196645 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:15.826756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9230e9-f4c3-4b88-b615-a21cc8196645 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:15.827088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9230e9-f4c3-4b88-b615-a21cc8196645 None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:15.828410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9230e9-f4c3-4b88-b615-a21cc8196645 None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:15.829323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 196/408] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:15.830417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554404b9-c531-4fa7-b8e2-fe53c312b0a5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:15.834543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9230e9-f4c3-4b88-b615-a21cc8196645 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:15.838632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 213/409] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:15 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:15.839599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9230e9-f4c3-4b88-b615-a21cc8196645 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:15.924178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:15.969944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9230e9-f4c3-4b88-b615-a21cc8196645 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:15.974188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554404b9-c531-4fa7-b8e2-fe53c312b0a5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:16.010386 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795bf70-18df-431f-9124-5a8f25e8b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:16.011033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795bf70-18df-431f-9124-5a8f25e8b8ba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.011318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795bf70-18df-431f-9124-5a8f25e8b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.011597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795bf70-18df-431f-9124-5a8f25e8b8ba None admin] PATH_INFO: `/v3/groups/f1124407958d49ffa4a725ffc9fb039e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.013087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795bf70-18df-431f-9124-5a8f25e8b8ba None admin] RBAC: Authorizing `identity:get_group(group_id=f1124407958d49ffa4a725ffc9fb039e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:16.014384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795bf70-18df-431f-9124-5a8f25e8b8ba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:16.015986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 214/410] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:15 2022] GET /identity/v3/groups/f1124407958d49ffa4a725ffc9fb039e => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:16.021312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795bf70-18df-431f-9124-5a8f25e8b8ba None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:16.026214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadd923-aa6d-4dad-a273-9b55a8cdec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:16.027700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadd923-aa6d-4dad-a273-9b55a8cdec5c None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.027700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadd923-aa6d-4dad-a273-9b55a8cdec5c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.027700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadd923-aa6d-4dad-a273-9b55a8cdec5c None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/groups/446d8bcaa1494ca89bc494ceadc81b8d/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.029517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadd923-aa6d-4dad-a273-9b55a8cdec5c None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4ae55af10f4cf08c544a37c7f275d9, group_id=446d8bcaa1494ca89bc494ceadc81b8d, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:16.031083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadd923-aa6d-4dad-a273-9b55a8cdec5c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:16.054054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 197/411] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Aug 31 00:55:15 2022] PUT /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/groups/446d8bcaa1494ca89bc494ceadc81b8d/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:55:16.056393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadd923-aa6d-4dad-a273-9b55a8cdec5c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:16.210536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:16.233626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795bf70-18df-431f-9124-5a8f25e8b8ba None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:16.280252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadd923-aa6d-4dad-a273-9b55a8cdec5c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:16.280593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3644a29-5324-4a1a-b874-0004f5ca53d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:16.281043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3644a29-5324-4a1a-b874-0004f5ca53d8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.281334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3644a29-5324-4a1a-b874-0004f5ca53d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.281613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3644a29-5324-4a1a-b874-0004f5ca53d8 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.282815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3644a29-5324-4a1a-b874-0004f5ca53d8 None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:16.285707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3644a29-5324-4a1a-b874-0004f5ca53d8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:16.287722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 215/412] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:16 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:16.289245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948aade-5997-48ee-8a6a-fffb8d976622 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.289534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948aade-5997-48ee-8a6a-fffb8d976622 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.289812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948aade-5997-48ee-8a6a-fffb8d976622 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.296118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 216/413] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:16.296118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948aade-5997-48ee-8a6a-fffb8d976622 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:16.316718 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:16.339961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a08449-8ea8-4567-8930-34eaf06a08cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:16.340905 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08449-8ea8-4567-8930-34eaf06a08cb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.341360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08449-8ea8-4567-8930-34eaf06a08cb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.342052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08449-8ea8-4567-8930-34eaf06a08cb None admin] PATH_INFO: `/v3/projects/945912bdd11549de9a3f98d9095b0494` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.343342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a08449-8ea8-4567-8930-34eaf06a08cb None admin] RBAC: Authorizing `identity:get_project(project_id=945912bdd11549de9a3f98d9095b0494)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:16.344967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a08449-8ea8-4567-8930-34eaf06a08cb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:16.351338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 198/414] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:16 2022] GET /identity/v3/projects/945912bdd11549de9a3f98d9095b0494 => generated 344 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:16.351338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde7649-8fc0-4f94-9124-2e3093be60c3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.351338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde7649-8fc0-4f94-9124-2e3093be60c3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.351338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde7649-8fc0-4f94-9124-2e3093be60c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.369024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7dde7649-8fc0-4f94-9124-2e3093be60c3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:16.370884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7dde7649-8fc0-4f94-9124-2e3093be60c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:16.447934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948aade-5997-48ee-8a6a-fffb8d976622 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:16.462643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 199/415] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:16.462643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14036-011b-41f4-b9c8-21bb349c3bde None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.462643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14036-011b-41f4-b9c8-21bb349c3bde None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.462643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14036-011b-41f4-b9c8-21bb349c3bde None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.462643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 200/416] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:16.462643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de14036-011b-41f4-b9c8-21bb349c3bde None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:16.519099 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf7d15-7f47-4c62-bf4c-cada52212df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:16.520658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf7d15-7f47-4c62-bf4c-cada52212df3 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.521086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf7d15-7f47-4c62-bf4c-cada52212df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.521507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf7d15-7f47-4c62-bf4c-cada52212df3 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/groups/446d8bcaa1494ca89bc494ceadc81b8d/roles/5923fa436ead4ac4b096b40af8672f94` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.525726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf7d15-7f47-4c62-bf4c-cada52212df3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4ae55af10f4cf08c544a37c7f275d9, group_id=446d8bcaa1494ca89bc494ceadc81b8d, role_id=5923fa436ead4ac4b096b40af8672f94)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:16.528198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf7d15-7f47-4c62-bf4c-cada52212df3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:16.543048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:16.549876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 217/417] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Aug 31 00:55:16 2022] PUT /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9/groups/446d8bcaa1494ca89bc494ceadc81b8d/roles/5923fa436ead4ac4b096b40af8672f94 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:55:16.551261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c32cb-f111-49ef-ab95-4750f9d799e2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.551550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c32cb-f111-49ef-ab95-4750f9d799e2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.551879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c32cb-f111-49ef-ab95-4750f9d799e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.578926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f15c32cb-f111-49ef-ab95-4750f9d799e2 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:16.580627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f15c32cb-f111-49ef-ab95-4750f9d799e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:16.641340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de14036-011b-41f4-b9c8-21bb349c3bde None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:16.661131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:16.674132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 218/418] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:16.712816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2117c0-ccaa-4cb8-85ae-b695064f9013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:16.713546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2117c0-ccaa-4cb8-85ae-b695064f9013 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.713833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2117c0-ccaa-4cb8-85ae-b695064f9013 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.714170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2117c0-ccaa-4cb8-85ae-b695064f9013 None admin] PATH_INFO: `/v3/projects/945912bdd11549de9a3f98d9095b0494/groups/f1124407958d49ffa4a725ffc9fb039e/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.716160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2117c0-ccaa-4cb8-85ae-b695064f9013 None admin] RBAC: Authorizing `identity:create_grant(project_id=945912bdd11549de9a3f98d9095b0494, group_id=f1124407958d49ffa4a725ffc9fb039e, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:16.718002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2117c0-ccaa-4cb8-85ae-b695064f9013 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:16.746199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 201/419] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Aug 31 00:55:16 2022] PUT /identity/v3/projects/945912bdd11549de9a3f98d9095b0494/groups/f1124407958d49ffa4a725ffc9fb039e/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:55:16.748601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c32cb-f111-49ef-ab95-4750f9d799e2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:16.931284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c32cb-f111-49ef-ab95-4750f9d799e2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:16.983236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cea903-57e5-4fdb-9e31-c5dad583b7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:16.984125 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cea903-57e5-4fdb-9e31-c5dad583b7ce None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:16.984650 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cea903-57e5-4fdb-9e31-c5dad583b7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:16.985071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cea903-57e5-4fdb-9e31-c5dad583b7ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:16.998257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cea903-57e5-4fdb-9e31-c5dad583b7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-73cea903-57e5-4fdb-9e31-c5dad583b7ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:17.003889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:17.005016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:17.006006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:17.008961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 219/420] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:55:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:17.014854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2117c0-ccaa-4cb8-85ae-b695064f9013 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:17.033793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cea903-57e5-4fdb-9e31-c5dad583b7ce None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:17.114892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:17.152530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cea903-57e5-4fdb-9e31-c5dad583b7ce None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:17.192011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c27bc-80ca-4ff5-a51f-d3feb98bac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:17.192617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c27bc-80ca-4ff5-a51f-d3feb98bac42 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:17.192906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c27bc-80ca-4ff5-a51f-d3feb98bac42 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:17.193190 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c27bc-80ca-4ff5-a51f-d3feb98bac42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:17.205339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c27bc-80ca-4ff5-a51f-d3feb98bac42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-433c27bc-80ca-4ff5-a51f-d3feb98bac42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:17.210627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:17.211614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:17.212555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:17.213172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 220/421] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:17.225710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c27bc-80ca-4ff5-a51f-d3feb98bac42 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:17.233188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2117c0-ccaa-4cb8-85ae-b695064f9013 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:17.268732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:17.305899 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbb82b-d767-463a-9745-4a5990bb1911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:17.306535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbb82b-d767-463a-9745-4a5990bb1911 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:17.306819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbb82b-d767-463a-9745-4a5990bb1911 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:17.307095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbb82b-d767-463a-9745-4a5990bb1911 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:17.307826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbb82b-d767-463a-9745-4a5990bb1911 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:17.308098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbb82b-d767-463a-9745-4a5990bb1911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:17.309546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbb82b-d767-463a-9745-4a5990bb1911 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:17.328468 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 202/422] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:17.334766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbb82b-d767-463a-9745-4a5990bb1911 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:17.434066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c27bc-80ca-4ff5-a51f-d3feb98bac42 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:17.484280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:17.525457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbb82b-d767-463a-9745-4a5990bb1911 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:17.557154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6148aa-cb0e-42a4-ad5f-95044231d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:17.557791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6148aa-cb0e-42a4-ad5f-95044231d002 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:17.558075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6148aa-cb0e-42a4-ad5f-95044231d002 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:17.558351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6148aa-cb0e-42a4-ad5f-95044231d002 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:17.559029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6148aa-cb0e-42a4-ad5f-95044231d002 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:17.559338 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6148aa-cb0e-42a4-ad5f-95044231d002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:17.563677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6148aa-cb0e-42a4-ad5f-95044231d002 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:17.571157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be824a3-b178-4282-90a7-abc6d26bd3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:17.574119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be824a3-b178-4282-90a7-abc6d26bd3eb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:17.574640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be824a3-b178-4282-90a7-abc6d26bd3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:17.575146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be824a3-b178-4282-90a7-abc6d26bd3eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:17.588965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 221/423] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:17.602528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6148aa-cb0e-42a4-ad5f-95044231d002 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:17.644392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:17.668264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be824a3-b178-4282-90a7-abc6d26bd3eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:17.670201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be824a3-b178-4282-90a7-abc6d26bd3eb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:17.782175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 203/424] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:55:17.787569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be824a3-b178-4282-90a7-abc6d26bd3eb None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:17.894366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6148aa-cb0e-42a4-ad5f-95044231d002 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:17.928832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:17.938497 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be824a3-b178-4282-90a7-abc6d26bd3eb None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:17.993749 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b8125-7bdb-446d-a251-b17d499b4899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:17.994573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b8125-7bdb-446d-a251-b17d499b4899 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:17.994927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b8125-7bdb-446d-a251-b17d499b4899 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:17.995276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b8125-7bdb-446d-a251-b17d499b4899 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:17.996809 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b8125-7bdb-446d-a251-b17d499b4899 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:17.998339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b8125-7bdb-446d-a251-b17d499b4899 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:18.000130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cae3ec-6403-47e6-b1e8-ba635d8eb493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:18.000458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 204/425] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:17 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:18.000793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae3ec-6403-47e6-b1e8-ba635d8eb493 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:18.001078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae3ec-6403-47e6-b1e8-ba635d8eb493 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:18.001356 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae3ec-6403-47e6-b1e8-ba635d8eb493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:18.006199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b8125-7bdb-446d-a251-b17d499b4899 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:18.103424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:18.167936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cae3ec-6403-47e6-b1e8-ba635d8eb493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:18.169680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cae3ec-6403-47e6-b1e8-ba635d8eb493 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:18.201509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b8125-7bdb-446d-a251-b17d499b4899 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:18.276622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0f321-d17f-40a7-b7dd-bd385dcac2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:18.277267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f321-d17f-40a7-b7dd-bd385dcac2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:18.277547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f321-d17f-40a7-b7dd-bd385dcac2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:18.277819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f321-d17f-40a7-b7dd-bd385dcac2a4 None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:18.281752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0f321-d17f-40a7-b7dd-bd385dcac2a4 None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:18.283192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0f321-d17f-40a7-b7dd-bd385dcac2a4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:18.285281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 205/426] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:18 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:18.294138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0f321-d17f-40a7-b7dd-bd385dcac2a4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:18.334194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:18.416645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 222/427] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:55:18.429436 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cae3ec-6403-47e6-b1e8-ba635d8eb493 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:18.443475 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0f321-d17f-40a7-b7dd-bd385dcac2a4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:18.487397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8963c2b-ec2c-4597-bed1-2ac5de442edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:18.488253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963c2b-ec2c-4597-bed1-2ac5de442edb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:18.488727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963c2b-ec2c-4597-bed1-2ac5de442edb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:18.489147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963c2b-ec2c-4597-bed1-2ac5de442edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:18.490313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8963c2b-ec2c-4597-bed1-2ac5de442edb None admin] RBAC: Adding query filter params (group.id=446d8bcaa1494ca89bc494ceadc81b8d, role.id=5923fa436ead4ac4b096b40af8672f94, scope.project.id=63e130b98cab47d38aafc327c5475d29) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:18.490769 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8963c2b-ec2c-4597-bed1-2ac5de442edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:18.492690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8963c2b-ec2c-4597-bed1-2ac5de442edb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:18.500860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 206/428] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Aug 31 00:55:18 2022] GET /identity/v3/role_assignments?group.id=446d8bcaa1494ca89bc494ceadc81b8d&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=5923fa436ead4ac4b096b40af8672f94 => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:18.539217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056087f6-5b5f-4c36-9c4b-08ca0cb167bb None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:18.541035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056087f6-5b5f-4c36-9c4b-08ca0cb167bb None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:18.541536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056087f6-5b5f-4c36-9c4b-08ca0cb167bb None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:18.544151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 207/429] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:55:18.550082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533daf8-c225-4c98-bd41-09c57b1974ff None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:18.550380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533daf8-c225-4c98-bd41-09c57b1974ff None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:18.550665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533daf8-c225-4c98-bd41-09c57b1974ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:18.597510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e533daf8-c225-4c98-bd41-09c57b1974ff None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:18.600585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e533daf8-c225-4c98-bd41-09c57b1974ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:18.617155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:18.667039 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cae3ec-6403-47e6-b1e8-ba635d8eb493 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:18.740064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288f4c-31e5-4c76-b481-b89646368b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:18.741815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288f4c-31e5-4c76-b481-b89646368b71 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:18.741971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288f4c-31e5-4c76-b481-b89646368b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:18.742302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288f4c-31e5-4c76-b481-b89646368b71 None admin] PATH_INFO: `/v3/projects/63e130b98cab47d38aafc327c5475d29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:18.745734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2288f4c-31e5-4c76-b481-b89646368b71 None admin] RBAC: Authorizing `identity:get_project(project_id=63e130b98cab47d38aafc327c5475d29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:18.747467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2288f4c-31e5-4c76-b481-b89646368b71 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:18.749394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 223/431] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:18 2022] GET /identity/v3/projects/63e130b98cab47d38aafc327c5475d29 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:18.756862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 208/431] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:18.762543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288f4c-31e5-4c76-b481-b89646368b71 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:18.896280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288f4c-31e5-4c76-b481-b89646368b71 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:18.933405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d987e-6eaf-4b6f-ad26-8d2376475a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:18.933960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d987e-6eaf-4b6f-ad26-8d2376475a14 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:18.934241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d987e-6eaf-4b6f-ad26-8d2376475a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:18.934545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d987e-6eaf-4b6f-ad26-8d2376475a14 None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:18.935692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d987e-6eaf-4b6f-ad26-8d2376475a14 None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:18.937191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d987e-6eaf-4b6f-ad26-8d2376475a14 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:18.939171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 224/432] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:18 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:18.945041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533daf8-c225-4c98-bd41-09c57b1974ff None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:18.965255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:19.058394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533daf8-c225-4c98-bd41-09c57b1974ff None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:19.081510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d987e-6eaf-4b6f-ad26-8d2376475a14 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:19.095205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:19.103047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61635861-bfa8-4ebb-9902-0b8baae8a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:19.104373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61635861-bfa8-4ebb-9902-0b8baae8a6fe None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:19.105058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61635861-bfa8-4ebb-9902-0b8baae8a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:19.105716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61635861-bfa8-4ebb-9902-0b8baae8a6fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:19.107330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61635861-bfa8-4ebb-9902-0b8baae8a6fe None admin] RBAC: Adding query filter params (group.id=446d8bcaa1494ca89bc494ceadc81b8d, role.id=2db61e25a9cb41608fb5c1dd7983e1d9, scope.project.id=63e130b98cab47d38aafc327c5475d29) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:19.107851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61635861-bfa8-4ebb-9902-0b8baae8a6fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:19.110399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61635861-bfa8-4ebb-9902-0b8baae8a6fe None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:19.121041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 209/433] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Aug 31 00:55:18 2022] GET /identity/v3/role_assignments?group.id=446d8bcaa1494ca89bc494ceadc81b8d&scope.project.id=63e130b98cab47d38aafc327c5475d29&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:19.132368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7705402-124e-452f-923f-e61745b8a09d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:19.132368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7705402-124e-452f-923f-e61745b8a09d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:19.132368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7705402-124e-452f-923f-e61745b8a09d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:19.132368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 210/434] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:19.132368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00a2f-dc41-441f-bcd9-062050e19688 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:19.133501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00a2f-dc41-441f-bcd9-062050e19688 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:19.134111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00a2f-dc41-441f-bcd9-062050e19688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:19.159832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a0f00a2f-dc41-441f-bcd9-062050e19688 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:19.161246 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a0f00a2f-dc41-441f-bcd9-062050e19688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:19.238063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d987e-6eaf-4b6f-ad26-8d2376475a14 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:19.266537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 211/435] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:19.266537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533256a2-f87f-4207-b383-43cfdd68b5ae None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:19.266537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533256a2-f87f-4207-b383-43cfdd68b5ae None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:19.266892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533256a2-f87f-4207-b383-43cfdd68b5ae None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:19.268300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 212/436] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:19.274155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9267-c267-4f4b-88dd-14d836f4d867 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:19.274732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9267-c267-4f4b-88dd-14d836f4d867 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:19.274952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9267-c267-4f4b-88dd-14d836f4d867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:19.283491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:19.293357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe72ae5-b443-4092-bc30-da33d1b133b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:19.294375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe72ae5-b443-4092-bc30-da33d1b133b7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:19.294818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe72ae5-b443-4092-bc30-da33d1b133b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:19.295280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe72ae5-b443-4092-bc30-da33d1b133b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:19.296580 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a0ed9267-c267-4f4b-88dd-14d836f4d867 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:19.299601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a0ed9267-c267-4f4b-88dd-14d836f4d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:19.317706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe72ae5-b443-4092-bc30-da33d1b133b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cbe72ae5-b443-4092-bc30-da33d1b133b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:19.326642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:19.328250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:19.329752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 225/437] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:19.334092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe72ae5-b443-4092-bc30-da33d1b133b7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:19.412592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 213/438] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:19.434984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:19.470726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe72ae5-b443-4092-bc30-da33d1b133b7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:19.517932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b6e22-e1bc-4506-b2bd-485d1c3ea9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:19.518864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6e22-e1bc-4506-b2bd-485d1c3ea9ce None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:19.519137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6e22-e1bc-4506-b2bd-485d1c3ea9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:19.519412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6e22-e1bc-4506-b2bd-485d1c3ea9ce None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:19.520085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b6e22-e1bc-4506-b2bd-485d1c3ea9ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:19.520416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b6e22-e1bc-4506-b2bd-485d1c3ea9ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:19.521779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b6e22-e1bc-4506-b2bd-485d1c3ea9ce None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:19.531766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 226/439] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:55:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:19.537599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9267-c267-4f4b-88dd-14d836f4d867 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:19.561886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b6e22-e1bc-4506-b2bd-485d1c3ea9ce None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:19.678423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9267-c267-4f4b-88dd-14d836f4d867 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:19.709703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b6e22-e1bc-4506-b2bd-485d1c3ea9ce None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:19.737966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165059b-6ff1-448d-b4b8-39740d118947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:19.739238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165059b-6ff1-448d-b4b8-39740d118947 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:19.739238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165059b-6ff1-448d-b4b8-39740d118947 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:19.739238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165059b-6ff1-448d-b4b8-39740d118947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:19.742972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:19.756797 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:19.764118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f55588-3018-4563-be11-34afb16376cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:19.765760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f55588-3018-4563-be11-34afb16376cd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:19.765760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f55588-3018-4563-be11-34afb16376cd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:19.765760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f55588-3018-4563-be11-34afb16376cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:19.778697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f55588-3018-4563-be11-34afb16376cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-39f55588-3018-4563-be11-34afb16376cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:19.785886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:19.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:19.787947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:19.788573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 227/440] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:55:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:19.789261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f55588-3018-4563-be11-34afb16376cd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:19.865931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165059b-6ff1-448d-b4b8-39740d118947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:19.868514 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165059b-6ff1-448d-b4b8-39740d118947 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:19.917405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f55588-3018-4563-be11-34afb16376cd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:19.951663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9379d59-41f2-4544-8d84-68c79f985907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:19.952299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9379d59-41f2-4544-8d84-68c79f985907 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:19.952608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9379d59-41f2-4544-8d84-68c79f985907 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:19.952882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9379d59-41f2-4544-8d84-68c79f985907 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:19.965208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9379d59-41f2-4544-8d84-68c79f985907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b9379d59-41f2-4544-8d84-68c79f985907 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:19.970369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:19.971326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:19.972108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 228/441] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:55:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:19.973332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9379d59-41f2-4544-8d84-68c79f985907 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:19.979443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 214/442] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:55:19.980292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165059b-6ff1-448d-b4b8-39740d118947 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:20.016256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:20.028612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:20.092006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9379d59-41f2-4544-8d84-68c79f985907 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:20.100565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165059b-6ff1-448d-b4b8-39740d118947 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:20.131505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae19ca-d7dc-48b8-aa95-3466a6c3a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:20.132119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae19ca-d7dc-48b8-aa95-3466a6c3a00b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:20.132443 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae19ca-d7dc-48b8-aa95-3466a6c3a00b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:20.132762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae19ca-d7dc-48b8-aa95-3466a6c3a00b None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:20.133438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae19ca-d7dc-48b8-aa95-3466a6c3a00b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:20.133742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae19ca-d7dc-48b8-aa95-3466a6c3a00b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:20.135124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae19ca-d7dc-48b8-aa95-3466a6c3a00b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:20.138132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabab5e-34af-429e-b88f-48ca00934ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:20.138752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabab5e-34af-429e-b88f-48ca00934ebe None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:20.139034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabab5e-34af-429e-b88f-48ca00934ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:20.139309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabab5e-34af-429e-b88f-48ca00934ebe None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:20.139987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabab5e-34af-429e-b88f-48ca00934ebe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:20.140350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabab5e-34af-429e-b88f-48ca00934ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:20.141808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabab5e-34af-429e-b88f-48ca00934ebe None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:20.150933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 229/443] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:20.150933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae19ca-d7dc-48b8-aa95-3466a6c3a00b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:20.151496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 215/444] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:20.152520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabab5e-34af-429e-b88f-48ca00934ebe None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:20.252548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:20.256797 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae19ca-d7dc-48b8-aa95-3466a6c3a00b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:20.259196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabab5e-34af-429e-b88f-48ca00934ebe None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:20.271915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:20.293504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f90627-53f1-4849-b4ee-7f0bc2366f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:20.294148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90627-53f1-4849-b4ee-7f0bc2366f78 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:20.294435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90627-53f1-4849-b4ee-7f0bc2366f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:20.294708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90627-53f1-4849-b4ee-7f0bc2366f78 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:20.295840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f90627-53f1-4849-b4ee-7f0bc2366f78 None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:20.297327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f90627-53f1-4849-b4ee-7f0bc2366f78 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:20.298967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 230/445] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:20 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:20.299732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f90627-53f1-4849-b4ee-7f0bc2366f78 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:20.299899 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68e4aa-159d-4896-a67e-59c405ac2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:20.300600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68e4aa-159d-4896-a67e-59c405ac2f1c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:20.300886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68e4aa-159d-4896-a67e-59c405ac2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:20.301162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68e4aa-159d-4896-a67e-59c405ac2f1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:20.384633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68e4aa-159d-4896-a67e-59c405ac2f1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:20.386065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68e4aa-159d-4896-a67e-59c405ac2f1c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:20.426043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f90627-53f1-4849-b4ee-7f0bc2366f78 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:20.475553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64bfe4-a82a-41e0-94e2-df1e84f0e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:20.476176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64bfe4-a82a-41e0-94e2-df1e84f0e2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:20.476543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64bfe4-a82a-41e0-94e2-df1e84f0e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:20.477330 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64bfe4-a82a-41e0-94e2-df1e84f0e2b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:20.490709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:20.498310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 216/446] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:20.499168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68e4aa-159d-4896-a67e-59c405ac2f1c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:20.533759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:20.556143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64bfe4-a82a-41e0-94e2-df1e84f0e2b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:20.558215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64bfe4-a82a-41e0-94e2-df1e84f0e2b9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:20.610266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68e4aa-159d-4896-a67e-59c405ac2f1c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:20.651875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3f998-424c-4edb-b9be-d81fd8d8c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:20.652546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3f998-424c-4edb-b9be-d81fd8d8c9fd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:20.652833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3f998-424c-4edb-b9be-d81fd8d8c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:20.653112 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3f998-424c-4edb-b9be-d81fd8d8c9fd None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:20.654271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3f998-424c-4edb-b9be-d81fd8d8c9fd None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:20.655730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3f998-424c-4edb-b9be-d81fd8d8c9fd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:20.657346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 217/447] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:20 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:20.662380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3f998-424c-4edb-b9be-d81fd8d8c9fd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:20.671132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 231/448] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:20.675834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64bfe4-a82a-41e0-94e2-df1e84f0e2b9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:20.735969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:20.767651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:20.790887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64bfe4-a82a-41e0-94e2-df1e84f0e2b9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:20.791101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3f998-424c-4edb-b9be-d81fd8d8c9fd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:20.845692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d60093-a8e3-4330-870a-92704a5cb9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:20.845919 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa63cd-ecd9-4bd0-973b-ed15ea8309e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:20.846632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d60093-a8e3-4330-870a-92704a5cb9ba None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:20.846750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa63cd-ecd9-4bd0-973b-ed15ea8309e3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:20.847086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa63cd-ecd9-4bd0-973b-ed15ea8309e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:20.847175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d60093-a8e3-4330-870a-92704a5cb9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:20.847532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa63cd-ecd9-4bd0-973b-ed15ea8309e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:20.847635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d60093-a8e3-4330-870a-92704a5cb9ba None admin] PATH_INFO: `/v3/projects/945912bdd11549de9a3f98d9095b0494` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:20.848814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa63cd-ecd9-4bd0-973b-ed15ea8309e3 None admin] RBAC: Adding query filter params (group.id=446d8bcaa1494ca89bc494ceadc81b8d, role.id=2db61e25a9cb41608fb5c1dd7983e1d9, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:20.849335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa63cd-ecd9-4bd0-973b-ed15ea8309e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:20.849428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d60093-a8e3-4330-870a-92704a5cb9ba None admin] RBAC: Authorizing `identity:get_project(project_id=945912bdd11549de9a3f98d9095b0494)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:20.852243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d60093-a8e3-4330-870a-92704a5cb9ba None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:20.852796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa63cd-ecd9-4bd0-973b-ed15ea8309e3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:20.855362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 218/449] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:20 2022] GET /identity/v3/projects/945912bdd11549de9a3f98d9095b0494 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:20.856534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d60093-a8e3-4330-870a-92704a5cb9ba None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:20.864883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 232/450] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Aug 31 00:55:20 2022] GET /identity/v3/role_assignments?group.id=446d8bcaa1494ca89bc494ceadc81b8d&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=2db61e25a9cb41608fb5c1dd7983e1d9 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:20.865598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa63cd-ecd9-4bd0-973b-ed15ea8309e3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:20.994673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa63cd-ecd9-4bd0-973b-ed15ea8309e3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:21.007600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d60093-a8e3-4330-870a-92704a5cb9ba None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:21.032848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d702b-7685-4222-9cd2-c3e92c08c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:21.033504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d702b-7685-4222-9cd2-c3e92c08c362 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:21.033791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d702b-7685-4222-9cd2-c3e92c08c362 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:21.034070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d702b-7685-4222-9cd2-c3e92c08c362 None admin] PATH_INFO: `/v3/groups/f1124407958d49ffa4a725ffc9fb039e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:21.035224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d702b-7685-4222-9cd2-c3e92c08c362 None admin] RBAC: Authorizing `identity:get_group(group_id=f1124407958d49ffa4a725ffc9fb039e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:21.036909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d702b-7685-4222-9cd2-c3e92c08c362 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:21.038603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 233/451] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:20 2022] GET /identity/v3/groups/f1124407958d49ffa4a725ffc9fb039e => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:21.046621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d702b-7685-4222-9cd2-c3e92c08c362 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:21.059973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:21.066435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:21.071668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec6929-9f95-4464-8ac7-cff361d6bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:21.072567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6929-9f95-4464-8ac7-cff361d6bee6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:21.072853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6929-9f95-4464-8ac7-cff361d6bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:21.073134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6929-9f95-4464-8ac7-cff361d6bee6 None admin] PATH_INFO: `/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:21.074362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec6929-9f95-4464-8ac7-cff361d6bee6 None admin] RBAC: Authorizing `identity:get_project(project_id=bd4ae55af10f4cf08c544a37c7f275d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:21.075820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec6929-9f95-4464-8ac7-cff361d6bee6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:21.077565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 219/452] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:55:20 2022] GET /identity/v3/projects/bd4ae55af10f4cf08c544a37c7f275d9 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:21.083233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec6929-9f95-4464-8ac7-cff361d6bee6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:21.191067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d702b-7685-4222-9cd2-c3e92c08c362 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:21.228021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec6929-9f95-4464-8ac7-cff361d6bee6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:21.235981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f732ac7-be2f-44de-99e6-edd8c7802772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:21.236875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f732ac7-be2f-44de-99e6-edd8c7802772 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:21.237162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f732ac7-be2f-44de-99e6-edd8c7802772 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:21.237447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f732ac7-be2f-44de-99e6-edd8c7802772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:21.238197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f732ac7-be2f-44de-99e6-edd8c7802772 None admin] RBAC: Adding query filter params (group.id=f1124407958d49ffa4a725ffc9fb039e, role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=945912bdd11549de9a3f98d9095b0494) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:21.238514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f732ac7-be2f-44de-99e6-edd8c7802772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:21.239970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f732ac7-be2f-44de-99e6-edd8c7802772 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:21.255026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 234/453] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Aug 31 00:55:21 2022] GET /identity/v3/role_assignments?group.id=f1124407958d49ffa4a725ffc9fb039e&scope.project.id=945912bdd11549de9a3f98d9095b0494&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:21.274628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448174ac-bd35-4482-90dc-0851f5699eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:21.275285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448174ac-bd35-4482-90dc-0851f5699eaf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:21.275569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448174ac-bd35-4482-90dc-0851f5699eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:21.275863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448174ac-bd35-4482-90dc-0851f5699eaf None admin] PATH_INFO: `/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:21.277121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448174ac-bd35-4482-90dc-0851f5699eaf None admin] RBAC: Authorizing `identity:get_group(group_id=446d8bcaa1494ca89bc494ceadc81b8d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:21.278619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448174ac-bd35-4482-90dc-0851f5699eaf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:21.280295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 220/454] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Aug 31 00:55:21 2022] GET /identity/v3/groups/446d8bcaa1494ca89bc494ceadc81b8d => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:21.286479 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f732ac7-be2f-44de-99e6-edd8c7802772 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:21.386374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:21.409191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f732ac7-be2f-44de-99e6-edd8c7802772 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:21.448807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91941c9c-7b3f-4626-808f-e2e44f2adbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:21.449430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941c9c-7b3f-4626-808f-e2e44f2adbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:21.449710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941c9c-7b3f-4626-808f-e2e44f2adbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:21.449989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941c9c-7b3f-4626-808f-e2e44f2adbf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:21.450721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91941c9c-7b3f-4626-808f-e2e44f2adbf9 None admin] RBAC: Adding query filter params (group.id=446d8bcaa1494ca89bc494ceadc81b8d, role.id=5923fa436ead4ac4b096b40af8672f94, scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:21.451030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91941c9c-7b3f-4626-808f-e2e44f2adbf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:21.452509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91941c9c-7b3f-4626-808f-e2e44f2adbf9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:21.459038 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 235/455] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Aug 31 00:55:21 2022] GET /identity/v3/role_assignments?group.id=446d8bcaa1494ca89bc494ceadc81b8d&scope.project.id=bd4ae55af10f4cf08c544a37c7f275d9&role.id=5923fa436ead4ac4b096b40af8672f94 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:23.993391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64124fce-f4e6-45ca-a445-db9e373f06b9 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:23.993921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64124fce-f4e6-45ca-a445-db9e373f06b9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:23.994027 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64124fce-f4e6-45ca-a445-db9e373f06b9 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:23.995597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 221/456] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:24.001577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e178b3-0fda-4f4e-adc1-dcc47511bf52 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:24.002082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e178b3-0fda-4f4e-adc1-dcc47511bf52 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:24.002158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e178b3-0fda-4f4e-adc1-dcc47511bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:24.022461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-77e178b3-0fda-4f4e-adc1-dcc47511bf52 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:24.024406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-77e178b3-0fda-4f4e-adc1-dcc47511bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:24.098948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 236/457] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:24.369411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bd410-af1c-4759-8364-6e2ccf37f984 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:24.369761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bd410-af1c-4759-8364-6e2ccf37f984 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:24.369933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bd410-af1c-4759-8364-6e2ccf37f984 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:24.371459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 222/458] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:24.378922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc12ad-0ca1-4eb8-9511-7d556aebff01 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:24.379251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc12ad-0ca1-4eb8-9511-7d556aebff01 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:24.379477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc12ad-0ca1-4eb8-9511-7d556aebff01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:24.400133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-72dc12ad-0ca1-4eb8-9511-7d556aebff01 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:24.405632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-72dc12ad-0ca1-4eb8-9511-7d556aebff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:24.483630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 237/459] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:24.522554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bd410-af1c-4759-8364-6e2ccf37f984 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:24.600846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:24.645929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bd410-af1c-4759-8364-6e2ccf37f984 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:24.654881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806a36b-3f5e-4793-b736-2b6a43e811f8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:24.655259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806a36b-3f5e-4793-b736-2b6a43e811f8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:24.655483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806a36b-3f5e-4793-b736-2b6a43e811f8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:24.657055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 238/460] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:55:24.672021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194adf-e8cd-423c-95fa-74f6a108751f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:24.672703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194adf-e8cd-423c-95fa-74f6a108751f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:24.673186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194adf-e8cd-423c-95fa-74f6a108751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:24.684201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce96476-2e11-4f13-982d-4a1ed5e19a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:24.684883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce96476-2e11-4f13-982d-4a1ed5e19a8c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:24.685164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce96476-2e11-4f13-982d-4a1ed5e19a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:24.685439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce96476-2e11-4f13-982d-4a1ed5e19a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:24.687175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:24.699343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce96476-2e11-4f13-982d-4a1ed5e19a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:24.701165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce96476-2e11-4f13-982d-4a1ed5e19a8c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:24.710003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dd194adf-e8cd-423c-95fa-74f6a108751f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:24.711696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dd194adf-e8cd-423c-95fa-74f6a108751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4ce96476-2e11-4f13-982d-4a1ed5e19a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:24.719643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:24.720636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:24.721512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:24.721512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:24.721512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:24.723679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 223/461] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:24.729817 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce96476-2e11-4f13-982d-4a1ed5e19a8c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:24.840712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 239/462] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:24.841977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194adf-e8cd-423c-95fa-74f6a108751f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:24.865738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce96476-2e11-4f13-982d-4a1ed5e19a8c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:24.896429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:24.938436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bacae0-6b81-4ea9-8c00-b4c87e95cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:24.939379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bacae0-6b81-4ea9-8c00-b4c87e95cff0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:24.939832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bacae0-6b81-4ea9-8c00-b4c87e95cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:24.941936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bacae0-6b81-4ea9-8c00-b4c87e95cff0 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:24.943005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bacae0-6b81-4ea9-8c00-b4c87e95cff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:24.943521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bacae0-6b81-4ea9-8c00-b4c87e95cff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:24.950388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bacae0-6b81-4ea9-8c00-b4c87e95cff0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:24.988586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 224/463] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:24.996773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bacae0-6b81-4ea9-8c00-b4c87e95cff0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:25.037893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194adf-e8cd-423c-95fa-74f6a108751f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:25.074205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:25.085127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a6f3-4ce6-44f9-a589-9f960668de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:25.087460 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a6f3-4ce6-44f9-a589-9f960668de40 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:25.087973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a6f3-4ce6-44f9-a589-9f960668de40 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:25.088567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a6f3-4ce6-44f9-a589-9f960668de40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:25.113307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207a6f3-4ce6-44f9-a589-9f960668de40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:25.115115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207a6f3-4ce6-44f9-a589-9f960668de40 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6207a6f3-4ce6-44f9-a589-9f960668de40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:25.147257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:25.148187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:25.149775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:25.149775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:25.149775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:25.158549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 240/464] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:25.164935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a6f3-4ce6-44f9-a589-9f960668de40 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:25.224825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bacae0-6b81-4ea9-8c00-b4c87e95cff0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:25.267244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb97d42-afba-4af9-a058-78a228e9e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:25.268287 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb97d42-afba-4af9-a058-78a228e9e0dc None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:25.268891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb97d42-afba-4af9-a058-78a228e9e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:25.269315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb97d42-afba-4af9-a058-78a228e9e0dc None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:25.270489 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb97d42-afba-4af9-a058-78a228e9e0dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:25.273182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb97d42-afba-4af9-a058-78a228e9e0dc None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:25.299768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 225/465] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:55:24 2022] POST /identity/v3/users => generated 246 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:55:25.300083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a6f3-4ce6-44f9-a589-9f960668de40 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:25.305437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0a887-5299-4470-a364-e67378a1f646 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:25.305437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0a887-5299-4470-a364-e67378a1f646 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:25.305437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0a887-5299-4470-a364-e67378a1f646 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:25.305437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 226/466] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:25.305437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0a887-5299-4470-a364-e67378a1f646 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:25.357500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4f149-c7d4-4af9-8594-5a2ace714bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:25.358198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4f149-c7d4-4af9-8594-5a2ace714bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:25.358557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4f149-c7d4-4af9-8594-5a2ace714bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:25.358841 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4f149-c7d4-4af9-8594-5a2ace714bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:25.359523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4f149-c7d4-4af9-8594-5a2ace714bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:25.359830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4f149-c7d4-4af9-8594-5a2ace714bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:25.361724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4f149-c7d4-4af9-8594-5a2ace714bf0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:25.363207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:25.385324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 241/467] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:25.387091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b70ab-555b-4584-9821-188cf9197b29 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:25.387400 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b70ab-555b-4584-9821-188cf9197b29 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:25.387675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b70ab-555b-4584-9821-188cf9197b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:25.415129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-786b70ab-555b-4584-9821-188cf9197b29 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:25.417516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-786b70ab-555b-4584-9821-188cf9197b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:25.465392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0a887-5299-4470-a364-e67378a1f646 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:25.496941 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:25.515551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1a7c0-ebe2-41b5-83fa-a0020fb9dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:25.516358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1a7c0-ebe2-41b5-83fa-a0020fb9dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:25.516673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1a7c0-ebe2-41b5-83fa-a0020fb9dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:25.516946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1a7c0-ebe2-41b5-83fa-a0020fb9dbb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:25.537482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1a7c0-ebe2-41b5-83fa-a0020fb9dbb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:25.539882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1a7c0-ebe2-41b5-83fa-a0020fb9dbb3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:25.540169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 242/468] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:25.540987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b70ab-555b-4584-9821-188cf9197b29 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7fd1a7c0-ebe2-41b5-83fa-a0020fb9dbb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:25.562539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:25.564194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:25.565959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:25.565959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:25.565959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:25.565959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 227/469] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:25.569983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1a7c0-ebe2-41b5-83fa-a0020fb9dbb3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:25.695918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:25.698382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b70ab-555b-4584-9821-188cf9197b29 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:25.721903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1a7c0-ebe2-41b5-83fa-a0020fb9dbb3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:25.741934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2b57b-4019-46bd-976c-1db0b544259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:25.743085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2b57b-4019-46bd-976c-1db0b544259d None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:25.743366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2b57b-4019-46bd-976c-1db0b544259d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:25.743640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2b57b-4019-46bd-976c-1db0b544259d None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:25.744295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2b57b-4019-46bd-976c-1db0b544259d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:25.745815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2b57b-4019-46bd-976c-1db0b544259d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:25.771707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 243/470] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:55:25 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:55:25.787296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddd0e7-3a25-41d5-bc37-4e07a01eeba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:25.788299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd0e7-3a25-41d5-bc37-4e07a01eeba6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:25.789304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd0e7-3a25-41d5-bc37-4e07a01eeba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:25.790060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd0e7-3a25-41d5-bc37-4e07a01eeba6 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:25.792949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddd0e7-3a25-41d5-bc37-4e07a01eeba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:25.793284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddd0e7-3a25-41d5-bc37-4e07a01eeba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:25.794767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddd0e7-3a25-41d5-bc37-4e07a01eeba6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:25.818550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 228/471] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:25.823764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2b57b-4019-46bd-976c-1db0b544259d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:25.871556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:25.880900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddd0e7-3a25-41d5-bc37-4e07a01eeba6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:25.988690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2b57b-4019-46bd-976c-1db0b544259d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:26.031114 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddd0e7-3a25-41d5-bc37-4e07a01eeba6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:26.043970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359f05f-ce2e-4cd8-a4d4-82f10c662011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:26.045222 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359f05f-ce2e-4cd8-a4d4-82f10c662011 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:26.045726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359f05f-ce2e-4cd8-a4d4-82f10c662011 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:26.045946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359f05f-ce2e-4cd8-a4d4-82f10c662011 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:26.046637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359f05f-ce2e-4cd8-a4d4-82f10c662011 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:26.048087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359f05f-ce2e-4cd8-a4d4-82f10c662011 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:26.085323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 244/472] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:55:25 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:55:26.087757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fd77b-2b02-4e17-9160-a5feab5f8aa5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:26.088472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fd77b-2b02-4e17-9160-a5feab5f8aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:26.088978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fd77b-2b02-4e17-9160-a5feab5f8aa5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:26.090923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 245/473] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:26.096400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78679-6b5d-4794-bd76-9246beb65c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:26.097066 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78679-6b5d-4794-bd76-9246beb65c4b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:26.097368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78679-6b5d-4794-bd76-9246beb65c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:26.097638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78679-6b5d-4794-bd76-9246beb65c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:26.098022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35705421-7d23-477c-9715-70873f99f5c3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:26.098574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35705421-7d23-477c-9715-70873f99f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:26.099075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35705421-7d23-477c-9715-70873f99f5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:26.111824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a78679-6b5d-4794-bd76-9246beb65c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:26.113328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a78679-6b5d-4794-bd76-9246beb65c4b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:26.128479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:26.143000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-35705421-7d23-477c-9715-70873f99f5c3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-f2a78679-6b5d-4794-bd76-9246beb65c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:26.143400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:26.144297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:26.145232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:26.145232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:26.145232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:26.146097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 229/474] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:26.147528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-35705421-7d23-477c-9715-70873f99f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:26.160223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78679-6b5d-4794-bd76-9246beb65c4b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:26.345425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 246/475] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:26.362484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78679-6b5d-4794-bd76-9246beb65c4b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:26.411353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d857de-ff1f-4143-8df1-e258b7339000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:26.412040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d857de-ff1f-4143-8df1-e258b7339000 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:26.412362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d857de-ff1f-4143-8df1-e258b7339000 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:26.412638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d857de-ff1f-4143-8df1-e258b7339000 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:26.413298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d857de-ff1f-4143-8df1-e258b7339000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:26.413608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d857de-ff1f-4143-8df1-e258b7339000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:26.415882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d857de-ff1f-4143-8df1-e258b7339000 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:26.429361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 230/476] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:26.437281 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35705421-7d23-477c-9715-70873f99f5c3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:26.463970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:26.565801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35705421-7d23-477c-9715-70873f99f5c3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:26.606891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51f5d8-11fa-4cc1-beec-397307c1628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:26.607518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51f5d8-11fa-4cc1-beec-397307c1628d None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:26.607873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51f5d8-11fa-4cc1-beec-397307c1628d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:26.608219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51f5d8-11fa-4cc1-beec-397307c1628d None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:26.608979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51f5d8-11fa-4cc1-beec-397307c1628d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:26.610584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51f5d8-11fa-4cc1-beec-397307c1628d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:26.644500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 247/477] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:55:26 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:55:26.701136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d857de-ff1f-4143-8df1-e258b7339000 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:26.815277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:26.875518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d857de-ff1f-4143-8df1-e258b7339000 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:26.922510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af48d-716e-4356-8a09-c9df30c4abac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:26.923403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af48d-716e-4356-8a09-c9df30c4abac None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:26.923833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af48d-716e-4356-8a09-c9df30c4abac None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:26.924256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af48d-716e-4356-8a09-c9df30c4abac None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:26.925146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af48d-716e-4356-8a09-c9df30c4abac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:26.926703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af48d-716e-4356-8a09-c9df30c4abac None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:26.943871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.sql.core [None req-1b6af48d-716e-4356-8a09-c9df30c4abac None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:55:26.943871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:55:26.943871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [parameters: {'id': '6497e06325bb4c4a860ccacea7a844df', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:55:26.943871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81483) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-1b6af48d-716e-4356-8a09-c9df30c4abac None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application result.read() Aug 31 00:55:26.960579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:55:26.961725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application yield resource Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise self.value Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application session.commit() Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:55:26.962881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:55:26.963948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:55:26.964978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application result.read() Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:55:26.965791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [parameters: {'id': '6497e06325bb4c4a860ccacea7a844df', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:26.967029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:55:26.967952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:26.970558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 231/478] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Aug 31 00:55:26 2022] POST /identity/v3/roles => generated 144 bytes in 270 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:26.977025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51f5d8-11fa-4cc1-beec-397307c1628d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:27.081028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:27.105654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51f5d8-11fa-4cc1-beec-397307c1628d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:27.155822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626d3da-eddf-48dd-b7bb-fcb2d17ffb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:27.156518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626d3da-eddf-48dd-b7bb-fcb2d17ffb01 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:27.156910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626d3da-eddf-48dd-b7bb-fcb2d17ffb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:27.157186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626d3da-eddf-48dd-b7bb-fcb2d17ffb01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:27.174894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626d3da-eddf-48dd-b7bb-fcb2d17ffb01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c626d3da-eddf-48dd-b7bb-fcb2d17ffb01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:27.180795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:27.181676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:27.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 248/479] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:55:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:27.189418 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af48d-716e-4356-8a09-c9df30c4abac None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:27.344311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af48d-716e-4356-8a09-c9df30c4abac None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:27.384819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:27.398941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f87ab-5cca-4f48-bcb9-960d9f195400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:27.399945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f87ab-5cca-4f48-bcb9-960d9f195400 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:27.400175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f87ab-5cca-4f48-bcb9-960d9f195400 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:27.400485 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f87ab-5cca-4f48-bcb9-960d9f195400 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:27.401236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f87ab-5cca-4f48-bcb9-960d9f195400 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:27.402090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f87ab-5cca-4f48-bcb9-960d9f195400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:27.403613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f87ab-5cca-4f48-bcb9-960d9f195400 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:27.417015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 232/480] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:27.940905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aac743-eeeb-467f-9845-26962de1b5d2 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:27.940905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aac743-eeeb-467f-9845-26962de1b5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:27.940905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aac743-eeeb-467f-9845-26962de1b5d2 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:27.940905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 249/481] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:27.952794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c5497-028c-46e9-b938-3a8d63eee333 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:27.953101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c5497-028c-46e9-b938-3a8d63eee333 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:27.953359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c5497-028c-46e9-b938-3a8d63eee333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:27.989502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ba1c5497-028c-46e9-b938-3a8d63eee333 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:27.990780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ba1c5497-028c-46e9-b938-3a8d63eee333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:28.066896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 233/482] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:28.271179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace364-0d14-4fe7-88bb-bc36949a956c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:28.271179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace364-0d14-4fe7-88bb-bc36949a956c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:28.271179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace364-0d14-4fe7-88bb-bc36949a956c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:28.271179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 250/483] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:28.277133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a683c86-1245-4324-95b4-ca39acb98a46 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:28.277633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a683c86-1245-4324-95b4-ca39acb98a46 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:28.277705 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a683c86-1245-4324-95b4-ca39acb98a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:28.303776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2a683c86-1245-4324-95b4-ca39acb98a46 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:28.305627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2a683c86-1245-4324-95b4-ca39acb98a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:28.382172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 234/484] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:28.543847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ace364-0d14-4fe7-88bb-bc36949a956c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:28.650551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a683c86-1245-4324-95b4-ca39acb98a46 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:28.688161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ace364-0d14-4fe7-88bb-bc36949a956c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:28.708734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:28.744749 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:28.761266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9ea77-e264-42b5-b95b-e751c4979065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:28.761471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a683c86-1245-4324-95b4-ca39acb98a46 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:28.761925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9ea77-e264-42b5-b95b-e751c4979065 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:28.762213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9ea77-e264-42b5-b95b-e751c4979065 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:28.762495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9ea77-e264-42b5-b95b-e751c4979065 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:28.783312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9ea77-e264-42b5-b95b-e751c4979065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-61b9ea77-e264-42b5-b95b-e751c4979065 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:28.788210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:28.789205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:28.790177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:28.798804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 251/485] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:28.801186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9af7c-38a6-4b58-8bfc-5c3a8f230231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:28.801913 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9af7c-38a6-4b58-8bfc-5c3a8f230231 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:28.802262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9af7c-38a6-4b58-8bfc-5c3a8f230231 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:28.802610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9af7c-38a6-4b58-8bfc-5c3a8f230231 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:28.804279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9ea77-e264-42b5-b95b-e751c4979065 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:28.815586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9af7c-38a6-4b58-8bfc-5c3a8f230231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-6ea9af7c-38a6-4b58-8bfc-5c3a8f230231 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:28.821823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:28.823772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:28.825744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:28.832597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 235/486] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:28.833559 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9af7c-38a6-4b58-8bfc-5c3a8f230231 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:29.008284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9ea77-e264-42b5-b95b-e751c4979065 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:29.043764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9af7c-38a6-4b58-8bfc-5c3a8f230231 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:29.056798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:29.077374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc48c39-a432-4c3b-a107-e192c0d3ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:29.077997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc48c39-a432-4c3b-a107-e192c0d3ded2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.079986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc48c39-a432-4c3b-a107-e192c0d3ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.080269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc48c39-a432-4c3b-a107-e192c0d3ded2 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.082151 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc48c39-a432-4c3b-a107-e192c0d3ded2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:29.082459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc48c39-a432-4c3b-a107-e192c0d3ded2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:29.083853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc48c39-a432-4c3b-a107-e192c0d3ded2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:29.100280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 252/487] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:29.102509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7018-beff-4a11-bf43-f3bc175dc305 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.102816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7018-beff-4a11-bf43-f3bc175dc305 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.103094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7018-beff-4a11-bf43-f3bc175dc305 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.108364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 253/488] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:29.108364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7018-beff-4a11-bf43-f3bc175dc305 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:29.110659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1859d4-d32b-4adb-8c9d-52e164ba6658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:29.111388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1859d4-d32b-4adb-8c9d-52e164ba6658 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.111730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1859d4-d32b-4adb-8c9d-52e164ba6658 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.112067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1859d4-d32b-4adb-8c9d-52e164ba6658 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.112856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1859d4-d32b-4adb-8c9d-52e164ba6658 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:29.113226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1859d4-d32b-4adb-8c9d-52e164ba6658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:29.114683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1859d4-d32b-4adb-8c9d-52e164ba6658 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:29.128722 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 236/489] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:29.130226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618f2d-cc1d-48e0-bf45-cd43b4224a54 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.130584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618f2d-cc1d-48e0-bf45-cd43b4224a54 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.130937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618f2d-cc1d-48e0-bf45-cd43b4224a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.153314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e5618f2d-cc1d-48e0-bf45-cd43b4224a54 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:29.154577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e5618f2d-cc1d-48e0-bf45-cd43b4224a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:29.197736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:29.236212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 237/490] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:29.245406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5618f2d-cc1d-48e0-bf45-cd43b4224a54 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:29.273107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7018-beff-4a11-bf43-f3bc175dc305 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:29.326743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ebacc-5104-4731-8c78-d98ad1ab27ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:29.327658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ebacc-5104-4731-8c78-d98ad1ab27ff None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.328085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ebacc-5104-4731-8c78-d98ad1ab27ff None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.328524 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ebacc-5104-4731-8c78-d98ad1ab27ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.343638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ebacc-5104-4731-8c78-d98ad1ab27ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:29.345268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ebacc-5104-4731-8c78-d98ad1ab27ff None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:29.357403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4a5ebacc-5104-4731-8c78-d98ad1ab27ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:29.361086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:29.362206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:29.363286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:29.363286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:29.363286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:29.368499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 254/491] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:29.368499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d5b2f-ebc2-4e5c-af4f-45b4b02a62b7 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.368499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d5b2f-ebc2-4e5c-af4f-45b4b02a62b7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.368499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d5b2f-ebc2-4e5c-af4f-45b4b02a62b7 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.368499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 255/492] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:29.369482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5618f2d-cc1d-48e0-bf45-cd43b4224a54 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:29.378195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d5b2f-ebc2-4e5c-af4f-45b4b02a62b7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:29.411924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa975f-d1eb-4144-8339-ac5202028ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:29.412858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa975f-d1eb-4144-8339-ac5202028ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.413140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa975f-d1eb-4144-8339-ac5202028ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.413417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa975f-d1eb-4144-8339-ac5202028ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.425757 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa975f-d1eb-4144-8339-ac5202028ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:29.427226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa975f-d1eb-4144-8339-ac5202028ab0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-67aa975f-d1eb-4144-8339-ac5202028ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:29.443081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:29.444033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:29.444897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:29.444897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:29.444897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:29.444897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 238/493] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:29.445701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1390bb-391c-4120-9f62-febd638bd78d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.445906 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1390bb-391c-4120-9f62-febd638bd78d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.446188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1390bb-391c-4120-9f62-febd638bd78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.465530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2a1390bb-391c-4120-9f62-febd638bd78d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:29.466972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2a1390bb-391c-4120-9f62-febd638bd78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:29.499665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d5b2f-ebc2-4e5c-af4f-45b4b02a62b7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:29.507438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:29.538253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7472b-e1a2-46b9-9fed-a22039cd375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:29.539472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7472b-e1a2-46b9-9fed-a22039cd375c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.539903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7472b-e1a2-46b9-9fed-a22039cd375c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.540179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7472b-e1a2-46b9-9fed-a22039cd375c None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.544538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 239/494] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:29.544685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7472b-e1a2-46b9-9fed-a22039cd375c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:29.544685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7472b-e1a2-46b9-9fed-a22039cd375c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:29.544846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1390bb-391c-4120-9f62-febd638bd78d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:29.544921 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7472b-e1a2-46b9-9fed-a22039cd375c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:29.559393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 256/495] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:29.560298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7472b-e1a2-46b9-9fed-a22039cd375c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:29.633945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:29.656111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1390bb-391c-4120-9f62-febd638bd78d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:29.671353 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7472b-e1a2-46b9-9fed-a22039cd375c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:29.693693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931a539-79de-4fb0-b173-1943e5f5fde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:29.694549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931a539-79de-4fb0-b173-1943e5f5fde8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.695671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931a539-79de-4fb0-b173-1943e5f5fde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.696128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931a539-79de-4fb0-b173-1943e5f5fde8 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.697245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931a539-79de-4fb0-b173-1943e5f5fde8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:29.697729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931a539-79de-4fb0-b173-1943e5f5fde8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:29.699267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931a539-79de-4fb0-b173-1943e5f5fde8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:29.708476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56c60b-2e41-4e76-9223-256a5996e2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:29.709114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56c60b-2e41-4e76-9223-256a5996e2dc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.709806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56c60b-2e41-4e76-9223-256a5996e2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.709986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56c60b-2e41-4e76-9223-256a5996e2dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.714172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 240/496] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:29.715283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931a539-79de-4fb0-b173-1943e5f5fde8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:29.723414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56c60b-2e41-4e76-9223-256a5996e2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fc56c60b-2e41-4e76-9223-256a5996e2dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:29.729340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:29.730437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 257/497] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:29.731569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56c60b-2e41-4e76-9223-256a5996e2dc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:29.763765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:29.833128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931a539-79de-4fb0-b173-1943e5f5fde8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:29.848348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56c60b-2e41-4e76-9223-256a5996e2dc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:29.871315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca04b7-d41d-44b9-9e41-6b2f69164503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:29.871966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca04b7-d41d-44b9-9e41-6b2f69164503 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.872464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca04b7-d41d-44b9-9e41-6b2f69164503 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.872601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca04b7-d41d-44b9-9e41-6b2f69164503 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.880740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca04b7-d41d-44b9-9e41-6b2f69164503 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:29.883208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca04b7-d41d-44b9-9e41-6b2f69164503 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:29.887135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:29.887549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02063f-7da2-4f85-b3e6-94fd01c4247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:29.888015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02063f-7da2-4f85-b3e6-94fd01c4247e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:29.888392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02063f-7da2-4f85-b3e6-94fd01c4247e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:29.888675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02063f-7da2-4f85-b3e6-94fd01c4247e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:29.897072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02063f-7da2-4f85-b3e6-94fd01c4247e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:29.899168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02063f-7da2-4f85-b3e6-94fd01c4247e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-27ca04b7-d41d-44b9-9e41-6b2f69164503 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:29.899371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:29.900216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:29.901149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 241/498] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Aug 31 00:55:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:29.901711 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca04b7-d41d-44b9-9e41-6b2f69164503 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-0a02063f-7da2-4f85-b3e6-94fd01c4247e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:29.918910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:29.919918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:29.921325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:29.921325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:29.921325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:29.921325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:29.921325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:29.921325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:29.921325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:29.921325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:29.921325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:55:29.921325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:29.922813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 258/499] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:29.924109 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02063f-7da2-4f85-b3e6-94fd01c4247e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:30.019060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:30.026938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca04b7-d41d-44b9-9e41-6b2f69164503 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:30.038641 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02063f-7da2-4f85-b3e6-94fd01c4247e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:30.074768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ec7b5-9e83-464a-a9db-3549f68740e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:30.075409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ec7b5-9e83-464a-a9db-3549f68740e0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:30.075684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ec7b5-9e83-464a-a9db-3549f68740e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:30.075851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc4e5-0923-47ab-9118-6e081a75df91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:30.076003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ec7b5-9e83-464a-a9db-3549f68740e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:30.076462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc4e5-0923-47ab-9118-6e081a75df91 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:30.076758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc4e5-0923-47ab-9118-6e081a75df91 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:30.077009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc4e5-0923-47ab-9118-6e081a75df91 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:30.077698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbc4e5-0923-47ab-9118-6e081a75df91 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:30.078206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbc4e5-0923-47ab-9118-6e081a75df91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:30.079946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbc4e5-0923-47ab-9118-6e081a75df91 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:30.087271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ec7b5-9e83-464a-a9db-3549f68740e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:30.094695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 242/500] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:30.094695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc4e5-0923-47ab-9118-6e081a75df91 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f45ec7b5-9e83-464a-a9db-3549f68740e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:30.094914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:30.095790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 259/501] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:30.096634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ec7b5-9e83-464a-a9db-3549f68740e0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:30.179193 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:30.215229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ec7b5-9e83-464a-a9db-3549f68740e0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:30.224224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc4e5-0923-47ab-9118-6e081a75df91 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:30.250183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521058ac-d664-46a5-9924-b780f2538f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:30.250803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521058ac-d664-46a5-9924-b780f2538f4b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:30.251090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521058ac-d664-46a5-9924-b780f2538f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:30.251371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521058ac-d664-46a5-9924-b780f2538f4b None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:30.252117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521058ac-d664-46a5-9924-b780f2538f4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:30.252459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521058ac-d664-46a5-9924-b780f2538f4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:30.253918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521058ac-d664-46a5-9924-b780f2538f4b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:30.262707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6813ff-f011-449a-9e8a-ac8eebcd681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:30.263592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6813ff-f011-449a-9e8a-ac8eebcd681d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:30.264069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6813ff-f011-449a-9e8a-ac8eebcd681d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:30.264553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6813ff-f011-449a-9e8a-ac8eebcd681d None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:30.265515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6813ff-f011-449a-9e8a-ac8eebcd681d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:30.266144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6813ff-f011-449a-9e8a-ac8eebcd681d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:30.267660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6813ff-f011-449a-9e8a-ac8eebcd681d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:30.296997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 260/502] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Aug 31 00:55:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:30.296997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521058ac-d664-46a5-9924-b780f2538f4b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:30.299847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:30.316463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 243/503] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Aug 31 00:55:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:30.316463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6813ff-f011-449a-9e8a-ac8eebcd681d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:30.418596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521058ac-d664-46a5-9924-b780f2538f4b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:30.422751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6813ff-f011-449a-9e8a-ac8eebcd681d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:30.446045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:30.456155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50b4de-a559-4079-8f2b-0f4fff4343b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:30.456832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b4de-a559-4079-8f2b-0f4fff4343b9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:30.457118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b4de-a559-4079-8f2b-0f4fff4343b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:30.457395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b4de-a559-4079-8f2b-0f4fff4343b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:30.461810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a0866-0cb9-4cde-b2bf-4fc0fbfdc2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:30.462428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a0866-0cb9-4cde-b2bf-4fc0fbfdc2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:30.462718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a0866-0cb9-4cde-b2bf-4fc0fbfdc2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:30.463002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a0866-0cb9-4cde-b2bf-4fc0fbfdc2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:30.463678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a0866-0cb9-4cde-b2bf-4fc0fbfdc2d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:30.463989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a0866-0cb9-4cde-b2bf-4fc0fbfdc2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:30.465897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a0866-0cb9-4cde-b2bf-4fc0fbfdc2d0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:30.468513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50b4de-a559-4079-8f2b-0f4fff4343b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:30.469963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50b4de-a559-4079-8f2b-0f4fff4343b9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:30.474888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 244/504] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:30.475718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a0866-0cb9-4cde-b2bf-4fc0fbfdc2d0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6c50b4de-a559-4079-8f2b-0f4fff4343b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:30.490220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:30.491238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:30.492875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:30.492875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:30.492875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:30.492875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 261/505] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:30.493668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8322-1c79-4bff-b72e-48eaadf1a573 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:30.494364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8322-1c79-4bff-b72e-48eaadf1a573 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:30.494650 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8322-1c79-4bff-b72e-48eaadf1a573 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:30.496052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 262/506] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:30.496699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8322-1c79-4bff-b72e-48eaadf1a573 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:30.565060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:30.599508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a0866-0cb9-4cde-b2bf-4fc0fbfdc2d0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:30.616977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8322-1c79-4bff-b72e-48eaadf1a573 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:30.639736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faffb30-5427-4f60-a61a-d99e6a136d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:30.640457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faffb30-5427-4f60-a61a-d99e6a136d9c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:30.640786 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faffb30-5427-4f60-a61a-d99e6a136d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:30.641065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faffb30-5427-4f60-a61a-d99e6a136d9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:30.655672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac8597-9c58-4779-857e-45194c93c68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:30.656285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8597-9c58-4779-857e-45194c93c68c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:30.656600 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8597-9c58-4779-857e-45194c93c68c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:30.656872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8597-9c58-4779-857e-45194c93c68c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:30.695703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:30.719070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faffb30-5427-4f60-a61a-d99e6a136d9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:30.720600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faffb30-5427-4f60-a61a-d99e6a136d9c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:30.747161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac8597-9c58-4779-857e-45194c93c68c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:30.748674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac8597-9c58-4779-857e-45194c93c68c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:30.813937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:30.831634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 245/507] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:30.832645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faffb30-5427-4f60-a61a-d99e6a136d9c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:30.863565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 263/508] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:30.864461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac8597-9c58-4779-857e-45194c93c68c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:30.933092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:30.952648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faffb30-5427-4f60-a61a-d99e6a136d9c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:30.972952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac8597-9c58-4779-857e-45194c93c68c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:30.988900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c73ef2-5210-492c-9112-836b69e650d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:30.989533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c73ef2-5210-492c-9112-836b69e650d3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:30.989817 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c73ef2-5210-492c-9112-836b69e650d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:30.990095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c73ef2-5210-492c-9112-836b69e650d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.000412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c73ef2-5210-492c-9112-836b69e650d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.001876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c73ef2-5210-492c-9112-836b69e650d3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.007073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305f226-1145-4c60-a0ee-179a40d22306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.007707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305f226-1145-4c60-a0ee-179a40d22306 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.008015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305f226-1145-4c60-a0ee-179a40d22306 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.008438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305f226-1145-4c60-a0ee-179a40d22306 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.009253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305f226-1145-4c60-a0ee-179a40d22306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:31.009569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305f226-1145-4c60-a0ee-179a40d22306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.010952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305f226-1145-4c60-a0ee-179a40d22306 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-95c73ef2-5210-492c-9112-836b69e650d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:31.016550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:31.017540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:31.018380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:31.018380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:31.018380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:31.018380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 246/509] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:31.018921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e54f-beee-4045-9b17-ae6eff7d30d3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.019211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e54f-beee-4045-9b17-ae6eff7d30d3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.019482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e54f-beee-4045-9b17-ae6eff7d30d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.026007 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 264/510] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:31.027021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305f226-1145-4c60-a0ee-179a40d22306 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.038157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4797e54f-beee-4045-9b17-ae6eff7d30d3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:31.040031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4797e54f-beee-4045-9b17-ae6eff7d30d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:31.046320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:31.107795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 247/511] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:31.108511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e54f-beee-4045-9b17-ae6eff7d30d3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.146916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305f226-1145-4c60-a0ee-179a40d22306 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.177266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:31.183245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b0aff-00c0-4653-ab04-dddc7b014611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.183896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b0aff-00c0-4653-ab04-dddc7b014611 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.184208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b0aff-00c0-4653-ab04-dddc7b014611 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.184574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b0aff-00c0-4653-ab04-dddc7b014611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.195835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b0aff-00c0-4653-ab04-dddc7b014611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.197327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b0aff-00c0-4653-ab04-dddc7b014611 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-912b0aff-00c0-4653-ab04-dddc7b014611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:31.212814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:31.213763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:31.214596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:31.214596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:31.214596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:31.214596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 265/512] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:31.214596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b0aff-00c0-4653-ab04-dddc7b014611 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.224490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e54f-beee-4045-9b17-ae6eff7d30d3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.260706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f01c-5071-4b3d-96a9-d065b5fc94d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.261342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f01c-5071-4b3d-96a9-d065b5fc94d3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.261618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f01c-5071-4b3d-96a9-d065b5fc94d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.261895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f01c-5071-4b3d-96a9-d065b5fc94d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.272107 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4f01c-5071-4b3d-96a9-d065b5fc94d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.274568 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4f01c-5071-4b3d-96a9-d065b5fc94d3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.286161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-90f4f01c-5071-4b3d-96a9-d065b5fc94d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:31.289729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:31.295751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:31.296915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:31.296915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:31.296915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:31.296915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 248/513] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:31.296915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f01c-5071-4b3d-96a9-d065b5fc94d3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.329390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b0aff-00c0-4653-ab04-dddc7b014611 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.366174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a1450-5a0c-47a0-98b7-224ac579f3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.366783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a1450-5a0c-47a0-98b7-224ac579f3fd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.367707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a1450-5a0c-47a0-98b7-224ac579f3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.368050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a1450-5a0c-47a0-98b7-224ac579f3fd None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.368717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a1450-5a0c-47a0-98b7-224ac579f3fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:31.369023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a1450-5a0c-47a0-98b7-224ac579f3fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.370385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a1450-5a0c-47a0-98b7-224ac579f3fd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.383538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 266/514] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:31.384473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a1450-5a0c-47a0-98b7-224ac579f3fd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.406808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f01c-5071-4b3d-96a9-d065b5fc94d3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.423121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:31.441660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683b66-ad6e-4c36-8cee-721d6c13ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.442294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683b66-ad6e-4c36-8cee-721d6c13ac34 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.442579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683b66-ad6e-4c36-8cee-721d6c13ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.442852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683b66-ad6e-4c36-8cee-721d6c13ac34 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.450975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01683b66-ad6e-4c36-8cee-721d6c13ac34 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.451901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01683b66-ad6e-4c36-8cee-721d6c13ac34 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-01683b66-ad6e-4c36-8cee-721d6c13ac34 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:31.464570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:31.470493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 249/515] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:31.471673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683b66-ad6e-4c36-8cee-721d6c13ac34 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.493413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a1450-5a0c-47a0-98b7-224ac579f3fd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.519758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:31.528528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe1d11-952d-4c84-9f7e-57d0bb5c15a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.529143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe1d11-952d-4c84-9f7e-57d0bb5c15a1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.529428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe1d11-952d-4c84-9f7e-57d0bb5c15a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.529708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe1d11-952d-4c84-9f7e-57d0bb5c15a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.530351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe1d11-952d-4c84-9f7e-57d0bb5c15a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:31.530657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe1d11-952d-4c84-9f7e-57d0bb5c15a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.532022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe1d11-952d-4c84-9f7e-57d0bb5c15a1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.543381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 267/516] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:31.544065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe1d11-952d-4c84-9f7e-57d0bb5c15a1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.585894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683b66-ad6e-4c36-8cee-721d6c13ac34 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.620478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee062b-975d-45d2-abb6-5af2594a225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.621192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee062b-975d-45d2-abb6-5af2594a225a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.621482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee062b-975d-45d2-abb6-5af2594a225a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.621760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee062b-975d-45d2-abb6-5af2594a225a None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.622414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee062b-975d-45d2-abb6-5af2594a225a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:31.622720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee062b-975d-45d2-abb6-5af2594a225a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.624092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee062b-975d-45d2-abb6-5af2594a225a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.636129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 250/517] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:31.636971 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee062b-975d-45d2-abb6-5af2594a225a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.645601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe1d11-952d-4c84-9f7e-57d0bb5c15a1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.673928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:31.680210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fd4ed-1603-4141-aa8b-c1adbbffdb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.680846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fd4ed-1603-4141-aa8b-c1adbbffdb99 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.681124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fd4ed-1603-4141-aa8b-c1adbbffdb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.681402 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fd4ed-1603-4141-aa8b-c1adbbffdb99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.691902 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fd4ed-1603-4141-aa8b-c1adbbffdb99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.693385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fd4ed-1603-4141-aa8b-c1adbbffdb99 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d63fd4ed-1603-4141-aa8b-c1adbbffdb99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:31.707979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:31.709119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:31.709973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:31.709973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:31.709973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:31.709973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 268/518] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:31.709973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fd4ed-1603-4141-aa8b-c1adbbffdb99 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.743215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee062b-975d-45d2-abb6-5af2594a225a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.751494 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:31.778770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40637d90-e6b3-4872-909f-ca057605b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.779415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40637d90-e6b3-4872-909f-ca057605b584 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.779682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40637d90-e6b3-4872-909f-ca057605b584 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.779954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40637d90-e6b3-4872-909f-ca057605b584 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.786995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40637d90-e6b3-4872-909f-ca057605b584 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.788466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40637d90-e6b3-4872-909f-ca057605b584 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-40637d90-e6b3-4872-909f-ca057605b584 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:31.800550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:31.801676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 251/519] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:31.802779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40637d90-e6b3-4872-909f-ca057605b584 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.813982 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fd4ed-1603-4141-aa8b-c1adbbffdb99 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.847533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dbdb2-6313-431c-a40d-5cb8ba320176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.848137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbdb2-6313-431c-a40d-5cb8ba320176 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.848451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbdb2-6313-431c-a40d-5cb8ba320176 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.848725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbdb2-6313-431c-a40d-5cb8ba320176 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.849446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dbdb2-6313-431c-a40d-5cb8ba320176 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:31.849750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dbdb2-6313-431c-a40d-5cb8ba320176 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.851212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dbdb2-6313-431c-a40d-5cb8ba320176 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.868661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 269/520] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:31.869466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dbdb2-6313-431c-a40d-5cb8ba320176 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:31.905987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:31.912798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40637d90-e6b3-4872-909f-ca057605b584 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.947295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0d306-7d75-4a5a-8940-fb5c0c315094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:31.947927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0d306-7d75-4a5a-8940-fb5c0c315094 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:31.948210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0d306-7d75-4a5a-8940-fb5c0c315094 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:31.948523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0d306-7d75-4a5a-8940-fb5c0c315094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:31.955092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0d306-7d75-4a5a-8940-fb5c0c315094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:31.956567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0d306-7d75-4a5a-8940-fb5c0c315094 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:31.965533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:31.969445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dbdb2-6313-431c-a40d-5cb8ba320176 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-6cb0d306-7d75-4a5a-8940-fb5c0c315094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:31.969579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:31.970547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:31.971725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:31.971725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:31.971725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:31.971725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:31.971725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:31.971725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:31.971725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:31.971725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:31.971725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 252/521] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:31.971725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0d306-7d75-4a5a-8940-fb5c0c315094 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:32.006454 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462273d8-49e4-446d-8d70-26cce5c99553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:32.007006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462273d8-49e4-446d-8d70-26cce5c99553 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:32.007284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462273d8-49e4-446d-8d70-26cce5c99553 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:32.008096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462273d8-49e4-446d-8d70-26cce5c99553 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:32.014889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462273d8-49e4-446d-8d70-26cce5c99553 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:32.016413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462273d8-49e4-446d-8d70-26cce5c99553 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-462273d8-49e4-446d-8d70-26cce5c99553 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:32.030004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:32.031018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:32.032046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:32.032046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:32.032046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:32.032046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:32.032046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:32.032046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:32.032046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:32.032046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:32.032046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 270/522] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:32.032046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462273d8-49e4-446d-8d70-26cce5c99553 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:32.080565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0d306-7d75-4a5a-8940-fb5c0c315094 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:32.114577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64c9e-f4cd-4bbd-841a-89c4faec7ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:32.115190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64c9e-f4cd-4bbd-841a-89c4faec7ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:32.115477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64c9e-f4cd-4bbd-841a-89c4faec7ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:32.115758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64c9e-f4cd-4bbd-841a-89c4faec7ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:32.116438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf64c9e-f4cd-4bbd-841a-89c4faec7ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:32.116752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf64c9e-f4cd-4bbd-841a-89c4faec7ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:32.118651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf64c9e-f4cd-4bbd-841a-89c4faec7ee0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:32.131943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462273d8-49e4-446d-8d70-26cce5c99553 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:32.132952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 253/523] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:32.138723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64c9e-f4cd-4bbd-841a-89c4faec7ee0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:32.157306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:32.168302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969cffd-9bd8-4307-9331-06a0b72d44fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:32.168960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969cffd-9bd8-4307-9331-06a0b72d44fc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:32.169234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969cffd-9bd8-4307-9331-06a0b72d44fc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:32.169507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969cffd-9bd8-4307-9331-06a0b72d44fc None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:32.170227 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969cffd-9bd8-4307-9331-06a0b72d44fc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:32.170532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969cffd-9bd8-4307-9331-06a0b72d44fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:32.171953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969cffd-9bd8-4307-9331-06a0b72d44fc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:32.189173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 271/524] 10.222.0.83 () {56 vars in 1139 bytes} [Wed Aug 31 00:55:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:32.190010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969cffd-9bd8-4307-9331-06a0b72d44fc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:32.209537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:32.242464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64c9e-f4cd-4bbd-841a-89c4faec7ee0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:32.277925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9a1f7-6546-43c8-92d5-b2cb75766ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:32.278402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9a1f7-6546-43c8-92d5-b2cb75766ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:32.278689 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9a1f7-6546-43c8-92d5-b2cb75766ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:32.279052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9a1f7-6546-43c8-92d5-b2cb75766ad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:32.296778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969cffd-9bd8-4307-9331-06a0b72d44fc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:32.336824 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8ef9-db50-483c-b9da-874a465ad08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:32.337544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8ef9-db50-483c-b9da-874a465ad08e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:32.337721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8ef9-db50-483c-b9da-874a465ad08e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:32.337988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8ef9-db50-483c-b9da-874a465ad08e None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:32.338681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c8ef9-db50-483c-b9da-874a465ad08e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:32.338985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c8ef9-db50-483c-b9da-874a465ad08e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:32.340431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c8ef9-db50-483c-b9da-874a465ad08e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:32.358305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9a1f7-6546-43c8-92d5-b2cb75766ad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:32.358920 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 272/525] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:32.359767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8ef9-db50-483c-b9da-874a465ad08e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:32.359863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9a1f7-6546-43c8-92d5-b2cb75766ad4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:32.383223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:32.451335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:32.477078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8ef9-db50-483c-b9da-874a465ad08e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:32.484346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 254/526] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:32.485184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9a1f7-6546-43c8-92d5-b2cb75766ad4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:32.516070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52c158-a25d-4245-a136-42b0da77f872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:32.516726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c158-a25d-4245-a136-42b0da77f872 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:32.517009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c158-a25d-4245-a136-42b0da77f872 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:32.517289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c158-a25d-4245-a136-42b0da77f872 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:32.517983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52c158-a25d-4245-a136-42b0da77f872 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:32.518292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52c158-a25d-4245-a136-42b0da77f872 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:32.519736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52c158-a25d-4245-a136-42b0da77f872 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:32.533719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 273/527] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:32.535015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52c158-a25d-4245-a136-42b0da77f872 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:32.604517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9a1f7-6546-43c8-92d5-b2cb75766ad4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:32.623375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:32.642119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dbffd-9062-4061-8e03-835a673711a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:32.642732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dbffd-9062-4061-8e03-835a673711a5 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:32.643012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dbffd-9062-4061-8e03-835a673711a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:32.643287 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dbffd-9062-4061-8e03-835a673711a5 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:32.643929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dbffd-9062-4061-8e03-835a673711a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:32.645391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dbffd-9062-4061-8e03-835a673711a5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:32.650317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52c158-a25d-4245-a136-42b0da77f872 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:32.667617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 255/528] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:55:32 2022] POST /identity/v3/users => generated 247 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:55:32.668483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dbffd-9062-4061-8e03-835a673711a5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:32.697020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef101-cdac-4305-92f6-8b526f1a31a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:32.697648 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef101-cdac-4305-92f6-8b526f1a31a4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:32.697931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef101-cdac-4305-92f6-8b526f1a31a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:32.698206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef101-cdac-4305-92f6-8b526f1a31a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:32.702314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:32.781617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ef101-cdac-4305-92f6-8b526f1a31a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:32.783120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ef101-cdac-4305-92f6-8b526f1a31a4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:32.806059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dbffd-9062-4061-8e03-835a673711a5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:32.849654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a67f-8807-444e-bc0b-fa1602eefd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:32.850311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a67f-8807-444e-bc0b-fa1602eefd52 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:32.850596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a67f-8807-444e-bc0b-fa1602eefd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:32.850871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a67f-8807-444e-bc0b-fa1602eefd52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:32.852148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a67f-8807-444e-bc0b-fa1602eefd52 None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=deb70dd34dc642cfbb49b4e1a0434399) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:32.852494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a67f-8807-444e-bc0b-fa1602eefd52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:32.854078 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a67f-8807-444e-bc0b-fa1602eefd52 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:32.861488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 256/529] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:32 2022] GET /identity/v3/role_assignments?user.id=deb70dd34dc642cfbb49b4e1a0434399&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:32.862434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a67f-8807-444e-bc0b-fa1602eefd52 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:32.918027 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:32.922226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 274/530] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:32.923215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef101-cdac-4305-92f6-8b526f1a31a4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:32.970960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:33.026283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a67f-8807-444e-bc0b-fa1602eefd52 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:33.051956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef101-cdac-4305-92f6-8b526f1a31a4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:33.082831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9904ccd-b4f9-45ce-bf5a-6984fc5d1a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:33.083861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9904ccd-b4f9-45ce-bf5a-6984fc5d1a38 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:33.084311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9904ccd-b4f9-45ce-bf5a-6984fc5d1a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:33.085049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9904ccd-b4f9-45ce-bf5a-6984fc5d1a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:33.096149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27555-e312-4b47-a1b4-0860435befbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:33.096419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27555-e312-4b47-a1b4-0860435befbf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:33.096799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27555-e312-4b47-a1b4-0860435befbf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:33.097177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27555-e312-4b47-a1b4-0860435befbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:33.098033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27555-e312-4b47-a1b4-0860435befbf None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=a99d74d9d72c4fc2a363ce6559e4ddff) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:33.098451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27555-e312-4b47-a1b4-0860435befbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:33.100201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27555-e312-4b47-a1b4-0860435befbf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:33.101599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9904ccd-b4f9-45ce-bf5a-6984fc5d1a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:33.104658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9904ccd-b4f9-45ce-bf5a-6984fc5d1a38 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:33.107448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 275/531] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:32 2022] GET /identity/v3/role_assignments?user.id=a99d74d9d72c4fc2a363ce6559e4ddff&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:33.108683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27555-e312-4b47-a1b4-0860435befbf None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c9904ccd-b4f9-45ce-bf5a-6984fc5d1a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:33.127397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:33.128587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:33.129649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:33.129649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:33.129649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:33.137316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 257/532] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:33.139172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9904ccd-b4f9-45ce-bf5a-6984fc5d1a38 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:33.317713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:33.323491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27555-e312-4b47-a1b4-0860435befbf None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:33.333461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:33.347975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9904ccd-b4f9-45ce-bf5a-6984fc5d1a38 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:33.402991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19936e-625a-4d62-b424-61295c20cae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:33.403609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19936e-625a-4d62-b424-61295c20cae1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:33.403893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19936e-625a-4d62-b424-61295c20cae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:33.404169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19936e-625a-4d62-b424-61295c20cae1 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:33.405014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19936e-625a-4d62-b424-61295c20cae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:33.405321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19936e-625a-4d62-b424-61295c20cae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:33.406714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19936e-625a-4d62-b424-61295c20cae1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:33.409396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42131d1-3d8d-4ab4-828a-585276b01896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:33.410085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42131d1-3d8d-4ab4-828a-585276b01896 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:33.410366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42131d1-3d8d-4ab4-828a-585276b01896 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:33.410637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42131d1-3d8d-4ab4-828a-585276b01896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:33.434128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 258/533] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:33.435154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42131d1-3d8d-4ab4-828a-585276b01896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:33.436712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42131d1-3d8d-4ab4-828a-585276b01896 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:33.440489 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19936e-625a-4d62-b424-61295c20cae1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e42131d1-3d8d-4ab4-828a-585276b01896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:33.470021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:33.470973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:33.471821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:33.471821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:33.471821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:33.480900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 276/534] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:33.481921 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42131d1-3d8d-4ab4-828a-585276b01896 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:33.571554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19936e-625a-4d62-b424-61295c20cae1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:33.643627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f901cb-c310-4f38-9f72-f734cb37610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:33.643627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f901cb-c310-4f38-9f72-f734cb37610d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:33.643627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f901cb-c310-4f38-9f72-f734cb37610d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:33.643627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f901cb-c310-4f38-9f72-f734cb37610d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:33.657749 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42131d1-3d8d-4ab4-828a-585276b01896 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:33.660358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f901cb-c310-4f38-9f72-f734cb37610d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:33.662064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f901cb-c310-4f38-9f72-f734cb37610d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-63f901cb-c310-4f38-9f72-f734cb37610d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:33.688254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:33.689204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:33.690060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:33.690060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:33.690060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:33.690060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:33.690060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:33.690060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:33.690060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:33.690060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:33.690060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 259/535] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:33.696304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f901cb-c310-4f38-9f72-f734cb37610d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:33.714415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:33.719420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ab52d-0bbb-4c41-a05f-3ac6307dcc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:33.720238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ab52d-0bbb-4c41-a05f-3ac6307dcc8d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:33.720683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ab52d-0bbb-4c41-a05f-3ac6307dcc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:33.724625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ab52d-0bbb-4c41-a05f-3ac6307dcc8d None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:33.724625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ab52d-0bbb-4c41-a05f-3ac6307dcc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:33.724625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ab52d-0bbb-4c41-a05f-3ac6307dcc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:33.725321 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ab52d-0bbb-4c41-a05f-3ac6307dcc8d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:33.751735 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 277/536] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:33.758311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ab52d-0bbb-4c41-a05f-3ac6307dcc8d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:33.791704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:33.876519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f901cb-c310-4f38-9f72-f734cb37610d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:33.958527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51af3b-35fd-46e2-a456-c55bf86dffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:33.959057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51af3b-35fd-46e2-a456-c55bf86dffd1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:33.959350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51af3b-35fd-46e2-a456-c55bf86dffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:33.959615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51af3b-35fd-46e2-a456-c55bf86dffd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:33.960369 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51af3b-35fd-46e2-a456-c55bf86dffd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:33.961201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51af3b-35fd-46e2-a456-c55bf86dffd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:33.963272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51af3b-35fd-46e2-a456-c55bf86dffd1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:33.990796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ab52d-0bbb-4c41-a05f-3ac6307dcc8d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:34.033729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 260/537] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:34.040267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51af3b-35fd-46e2-a456-c55bf86dffd1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:34.104893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523bccf-20fc-410b-9998-935e24cb093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:34.107131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523bccf-20fc-410b-9998-935e24cb093a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:34.108511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523bccf-20fc-410b-9998-935e24cb093a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:34.109313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523bccf-20fc-410b-9998-935e24cb093a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:34.124467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523bccf-20fc-410b-9998-935e24cb093a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:34.127734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523bccf-20fc-410b-9998-935e24cb093a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4523bccf-20fc-410b-9998-935e24cb093a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:34.156976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:34.158653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:34.160232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:34.160232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:34.160232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:34.160232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:34.160232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:34.160232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:34.160232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:34.160232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:34.166315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 278/538] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:34.176585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523bccf-20fc-410b-9998-935e24cb093a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:34.222002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:34.281024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51af3b-35fd-46e2-a456-c55bf86dffd1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:34.344085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:34.348368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91f084-7267-42b4-b92d-2515fb76f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:34.349002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f084-7267-42b4-b92d-2515fb76f560 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:34.349397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f084-7267-42b4-b92d-2515fb76f560 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:34.349549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f084-7267-42b4-b92d-2515fb76f560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:34.350284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91f084-7267-42b4-b92d-2515fb76f560 None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=376dd413b33c4f4987f6bba3b14f3bd1) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:34.350605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91f084-7267-42b4-b92d-2515fb76f560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:34.352744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91f084-7267-42b4-b92d-2515fb76f560 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:34.368191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 261/539] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:34 2022] GET /identity/v3/role_assignments?user.id=376dd413b33c4f4987f6bba3b14f3bd1&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:34.391986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523bccf-20fc-410b-9998-935e24cb093a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:34.443453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a325f25-b4e5-40a1-a163-13627d6b52ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:34.445452 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325f25-b4e5-40a1-a163-13627d6b52ab None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:34.446226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325f25-b4e5-40a1-a163-13627d6b52ab None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:34.446769 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325f25-b4e5-40a1-a163-13627d6b52ab None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:34.447692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a325f25-b4e5-40a1-a163-13627d6b52ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:34.448211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a325f25-b4e5-40a1-a163-13627d6b52ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:34.450014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a325f25-b4e5-40a1-a163-13627d6b52ab None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:34.471621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 279/540] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:34.480208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91f084-7267-42b4-b92d-2515fb76f560 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:34.645575 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91f084-7267-42b4-b92d-2515fb76f560 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:34.690102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:34.696180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee68d7-79c0-46c5-a42f-37d680e52dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:34.696844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee68d7-79c0-46c5-a42f-37d680e52dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:34.697137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee68d7-79c0-46c5-a42f-37d680e52dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:34.697418 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee68d7-79c0-46c5-a42f-37d680e52dd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:34.698170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee68d7-79c0-46c5-a42f-37d680e52dd3 None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=f6c13711596647178ad3f93865eca187) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:34.700770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee68d7-79c0-46c5-a42f-37d680e52dd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:34.702235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee68d7-79c0-46c5-a42f-37d680e52dd3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:34.712346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 262/541] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:34 2022] GET /identity/v3/role_assignments?user.id=f6c13711596647178ad3f93865eca187&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:34.973383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee0b32-b4ec-4172-84fe-c0ed89684985 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:34.973734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee0b32-b4ec-4172-84fe-c0ed89684985 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:34.973946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee0b32-b4ec-4172-84fe-c0ed89684985 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:34.975662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 280/542] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:34.982221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae287f-a42c-497f-aee5-17eea80803c3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:34.982511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae287f-a42c-497f-aee5-17eea80803c3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:34.982795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae287f-a42c-497f-aee5-17eea80803c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:35.008841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9fae287f-a42c-497f-aee5-17eea80803c3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:35.010067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9fae287f-a42c-497f-aee5-17eea80803c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:35.096219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 263/543] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:35.314123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e007-54a7-4e03-81aa-3c76d4a5f064 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:35.314481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e007-54a7-4e03-81aa-3c76d4a5f064 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:35.314657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e007-54a7-4e03-81aa-3c76d4a5f064 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:35.316245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 281/544] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:35.321307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98266f-e743-4227-a2ea-2980433c2d03 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:35.321600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98266f-e743-4227-a2ea-2980433c2d03 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:35.321882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98266f-e743-4227-a2ea-2980433c2d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:35.347280 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7a98266f-e743-4227-a2ea-2980433c2d03 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:35.348527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7a98266f-e743-4227-a2ea-2980433c2d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:35.438781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 264/545] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:35.451020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342e007-54a7-4e03-81aa-3c76d4a5f064 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:35.471367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb44b7e-2a31-46df-a84b-0ea6f7139f34 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:35.471671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb44b7e-2a31-46df-a84b-0ea6f7139f34 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:35.471925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb44b7e-2a31-46df-a84b-0ea6f7139f34 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:35.473540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 265/546] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:35.479728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9416d6-8d90-4fed-8a01-b412218fb29e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:35.480014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9416d6-8d90-4fed-8a01-b412218fb29e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:35.480297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9416d6-8d90-4fed-8a01-b412218fb29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:35.501551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-da9416d6-8d90-4fed-8a01-b412218fb29e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:35.502798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-da9416d6-8d90-4fed-8a01-b412218fb29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:35.565895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:35.581700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 266/547] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:35.672075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342e007-54a7-4e03-81aa-3c76d4a5f064 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:35.720223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:35.731505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e31ed-5550-4427-94fd-d1b784e8d8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:35.732299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e31ed-5550-4427-94fd-d1b784e8d8ca None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:35.732712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e31ed-5550-4427-94fd-d1b784e8d8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:35.733141 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e31ed-5550-4427-94fd-d1b784e8d8ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:35.754596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e31ed-5550-4427-94fd-d1b784e8d8ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:35.760742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9416d6-8d90-4fed-8a01-b412218fb29e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8e5e31ed-5550-4427-94fd-d1b784e8d8ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:35.767271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:35.768152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:35.768976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:35.770150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 282/548] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:35.777577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e31ed-5550-4427-94fd-d1b784e8d8ca None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:35.885090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9416d6-8d90-4fed-8a01-b412218fb29e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:35.945862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3db5-dc6f-4458-89fc-f9263189576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:35.946539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3db5-dc6f-4458-89fc-f9263189576e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:35.946828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3db5-dc6f-4458-89fc-f9263189576e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:35.947106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3db5-dc6f-4458-89fc-f9263189576e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:35.954239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e31ed-5550-4427-94fd-d1b784e8d8ca None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:35.959014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f3db5-dc6f-4458-89fc-f9263189576e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2f7f3db5-dc6f-4458-89fc-f9263189576e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:35.964055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:35.965039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:35.965830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 267/549] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:35.966862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3db5-dc6f-4458-89fc-f9263189576e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:36.004209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5750d8c-f996-4f01-8f43-3bcf84753a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:36.004882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5750d8c-f996-4f01-8f43-3bcf84753a76 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.005437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5750d8c-f996-4f01-8f43-3bcf84753a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.005719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5750d8c-f996-4f01-8f43-3bcf84753a76 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.006960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5750d8c-f996-4f01-8f43-3bcf84753a76 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:36.008217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5750d8c-f996-4f01-8f43-3bcf84753a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:36.009936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5750d8c-f996-4f01-8f43-3bcf84753a76 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:36.021647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 283/550] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:36.023318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5750d8c-f996-4f01-8f43-3bcf84753a76 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:36.032731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:36.107581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:36.121366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3db5-dc6f-4458-89fc-f9263189576e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:36.180872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5750d8c-f996-4f01-8f43-3bcf84753a76 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:36.185453 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe86f95-b361-489b-b9fc-be66f8c25de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:36.186403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe86f95-b361-489b-b9fc-be66f8c25de0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.186889 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe86f95-b361-489b-b9fc-be66f8c25de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.187362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe86f95-b361-489b-b9fc-be66f8c25de0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.202844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe86f95-b361-489b-b9fc-be66f8c25de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9fe86f95-b361-489b-b9fc-be66f8c25de0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:36.210234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:36.211503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:36.212317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:36.214984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 268/551] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:36.219401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe86f95-b361-489b-b9fc-be66f8c25de0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:36.228143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee66f6-cef8-42e6-bd86-5297dc0d64dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:36.229296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee66f6-cef8-42e6-bd86-5297dc0d64dd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.229778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee66f6-cef8-42e6-bd86-5297dc0d64dd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.230321 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee66f6-cef8-42e6-bd86-5297dc0d64dd None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.231236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee66f6-cef8-42e6-bd86-5297dc0d64dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:36.231748 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee66f6-cef8-42e6-bd86-5297dc0d64dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:36.233442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee66f6-cef8-42e6-bd86-5297dc0d64dd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:36.244651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 284/552] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:36.246101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee66f6-cef8-42e6-bd86-5297dc0d64dd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:36.325634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe86f95-b361-489b-b9fc-be66f8c25de0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:36.333197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:36.361090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee66f6-cef8-42e6-bd86-5297dc0d64dd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:36.362585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c196-cb99-4330-8a7a-3b955dc44fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:36.363271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c196-cb99-4330-8a7a-3b955dc44fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.363505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c196-cb99-4330-8a7a-3b955dc44fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.363780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c196-cb99-4330-8a7a-3b955dc44fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.375227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1c196-cb99-4330-8a7a-3b955dc44fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:36.376832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1c196-cb99-4330-8a7a-3b955dc44fe4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:36.382415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b2c1c196-cb99-4330-8a7a-3b955dc44fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:36.396495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:36.397601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:36.399585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:36.399585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:36.399585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:36.399585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 269/553] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:36.399585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c196-cb99-4330-8a7a-3b955dc44fe4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:36.409751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79ecd-6280-4d85-982c-d5feef3657eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:36.410784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79ecd-6280-4d85-982c-d5feef3657eb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.411269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79ecd-6280-4d85-982c-d5feef3657eb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.411889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79ecd-6280-4d85-982c-d5feef3657eb None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.412946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79ecd-6280-4d85-982c-d5feef3657eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:36.413473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79ecd-6280-4d85-982c-d5feef3657eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:36.415990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79ecd-6280-4d85-982c-d5feef3657eb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:36.425669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 285/554] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:36.426881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79ecd-6280-4d85-982c-d5feef3657eb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:36.516445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c196-cb99-4330-8a7a-3b955dc44fe4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:36.541182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79ecd-6280-4d85-982c-d5feef3657eb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:36.552655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d412ff-aa76-4447-8013-bb74d780a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:36.553375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d412ff-aa76-4447-8013-bb74d780a767 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.553666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d412ff-aa76-4447-8013-bb74d780a767 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.553889 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d412ff-aa76-4447-8013-bb74d780a767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.564674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d412ff-aa76-4447-8013-bb74d780a767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:36.566098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d412ff-aa76-4447-8013-bb74d780a767 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:36.578617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65d27e-dce4-42c8-abd7-710345ef8a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:36.579231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d27e-dce4-42c8-abd7-710345ef8a4d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.579515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d27e-dce4-42c8-abd7-710345ef8a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.579793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d27e-dce4-42c8-abd7-710345ef8a4d None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.580475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65d27e-dce4-42c8-abd7-710345ef8a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:36.580774 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65d27e-dce4-42c8-abd7-710345ef8a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-88d412ff-aa76-4447-8013-bb74d780a767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:36.581482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:36.582783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:36.583669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:36.583669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:36.583669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:36.583832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65d27e-dce4-42c8-abd7-710345ef8a4d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:36.583901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 270/555] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:36.583901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d412ff-aa76-4447-8013-bb74d780a767 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:36.597112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 286/556] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:36.598289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef72a6-9b69-4e3d-b8ab-63057b50a150 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.598582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef72a6-9b69-4e3d-b8ab-63057b50a150 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.598860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef72a6-9b69-4e3d-b8ab-63057b50a150 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.604475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 287/557] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:36.604475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef72a6-9b69-4e3d-b8ab-63057b50a150 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:36.604662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:36.650798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:36.699095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d412ff-aa76-4447-8013-bb74d780a767 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:36.715244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef72a6-9b69-4e3d-b8ab-63057b50a150 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:36.733791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f3bd8-b8f4-42f6-abcd-bed05d2809be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:36.734425 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f3bd8-b8f4-42f6-abcd-bed05d2809be None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.734716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f3bd8-b8f4-42f6-abcd-bed05d2809be None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.734993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f3bd8-b8f4-42f6-abcd-bed05d2809be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.746847 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f3bd8-b8f4-42f6-abcd-bed05d2809be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:36.748820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f3bd8-b8f4-42f6-abcd-bed05d2809be None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:36.753419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c25639-2eb7-42ea-ad0f-eb94fad90413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:36.754235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c25639-2eb7-42ea-ad0f-eb94fad90413 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.754699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c25639-2eb7-42ea-ad0f-eb94fad90413 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.755212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c25639-2eb7-42ea-ad0f-eb94fad90413 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.756049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c25639-2eb7-42ea-ad0f-eb94fad90413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:36.756706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c25639-2eb7-42ea-ad0f-eb94fad90413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:36.758162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c25639-2eb7-42ea-ad0f-eb94fad90413 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-a25f3bd8-b8f4-42f6-abcd-bed05d2809be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:36.763060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:36.765164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:36.766142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:36.766142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:36.766142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:36.766142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 271/558] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:36.766142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f3bd8-b8f4-42f6-abcd-bed05d2809be None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:36.772377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 288/559] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:36.773515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43af1c-6be9-451f-9a71-4d31c995ece5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.774018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43af1c-6be9-451f-9a71-4d31c995ece5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.774294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43af1c-6be9-451f-9a71-4d31c995ece5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.793036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ee43af1c-6be9-451f-9a71-4d31c995ece5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:36.794221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ee43af1c-6be9-451f-9a71-4d31c995ece5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:36.847375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:36.876493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 289/560] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:36.877901 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43af1c-6be9-451f-9a71-4d31c995ece5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:36.900524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f3bd8-b8f4-42f6-abcd-bed05d2809be None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:36.915739 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:36.948297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0e6a5-cc47-40f8-8680-71c69acc51f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:36.948972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0e6a5-cc47-40f8-8680-71c69acc51f0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:36.949313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0e6a5-cc47-40f8-8680-71c69acc51f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:36.949535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0e6a5-cc47-40f8-8680-71c69acc51f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:36.958290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0e6a5-cc47-40f8-8680-71c69acc51f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:36.961257 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0e6a5-cc47-40f8-8680-71c69acc51f0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-48e0e6a5-cc47-40f8-8680-71c69acc51f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:36.975806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:36.977895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:36.979331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:36.979331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:36.979331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:36.979331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:36.979331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:36.979331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:36.979331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:36.979331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:36.979331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:55:36.979331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:36.982460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 272/561] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:55:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:36.983422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0e6a5-cc47-40f8-8680-71c69acc51f0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:37.015553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43af1c-6be9-451f-9a71-4d31c995ece5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:37.059864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b0577-e1d4-4d1e-bb16-0b00ecb50aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:37.060929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b0577-e1d4-4d1e-bb16-0b00ecb50aee None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.061513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b0577-e1d4-4d1e-bb16-0b00ecb50aee None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.062211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b0577-e1d4-4d1e-bb16-0b00ecb50aee None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.063506 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b0577-e1d4-4d1e-bb16-0b00ecb50aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:37.064147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b0577-e1d4-4d1e-bb16-0b00ecb50aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:37.067159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b0577-e1d4-4d1e-bb16-0b00ecb50aee None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:37.090368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 290/562] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:37.092530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b0577-e1d4-4d1e-bb16-0b00ecb50aee None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:37.136747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0e6a5-cc47-40f8-8680-71c69acc51f0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:37.172283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:37.191293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609fe40-0fe1-479e-bec7-2de015a6e1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:37.192043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609fe40-0fe1-479e-bec7-2de015a6e1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.192350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609fe40-0fe1-479e-bec7-2de015a6e1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.192700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609fe40-0fe1-479e-bec7-2de015a6e1e4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.202281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609fe40-0fe1-479e-bec7-2de015a6e1e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:37.203856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609fe40-0fe1-479e-bec7-2de015a6e1e4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-1609fe40-0fe1-479e-bec7-2de015a6e1e4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:37.218223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:37.219321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:37.220239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:37.220239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:37.220239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:37.220239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:37.220239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:37.220239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:37.220239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:37.220239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:37.220239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:55:37.220239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:37.220800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:37.225611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 273/563] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:37.227090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609fe40-0fe1-479e-bec7-2de015a6e1e4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:37.233492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b0577-e1d4-4d1e-bb16-0b00ecb50aee None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:37.272739 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ad47d-02d0-44bb-9509-d8927c2698ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:37.273946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ad47d-02d0-44bb-9509-d8927c2698ae None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.274230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ad47d-02d0-44bb-9509-d8927c2698ae None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.274507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ad47d-02d0-44bb-9509-d8927c2698ae None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.275258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ad47d-02d0-44bb-9509-d8927c2698ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:37.275565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ad47d-02d0-44bb-9509-d8927c2698ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:37.277112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ad47d-02d0-44bb-9509-d8927c2698ae None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:37.296523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 291/564] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Aug 31 00:55:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:37.297204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ad47d-02d0-44bb-9509-d8927c2698ae None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:37.343299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609fe40-0fe1-479e-bec7-2de015a6e1e4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:37.378346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1fcf9-7913-401b-a3f8-d4b039788c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:37.378983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1fcf9-7913-401b-a3f8-d4b039788c11 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.379266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1fcf9-7913-401b-a3f8-d4b039788c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.379544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1fcf9-7913-401b-a3f8-d4b039788c11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.387742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1fcf9-7913-401b-a3f8-d4b039788c11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:37.389217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1fcf9-7913-401b-a3f8-d4b039788c11 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:37.400200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ad47d-02d0-44bb-9509-d8927c2698ae None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-fdb1fcf9-7913-401b-a3f8-d4b039788c11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:37.401195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:37.402074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:37.403012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 274/565] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Aug 31 00:55:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:37.403602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1fcf9-7913-401b-a3f8-d4b039788c11 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:37.443849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902d1f8-ddaa-4933-ae23-941947bc9e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:37.444499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902d1f8-ddaa-4933-ae23-941947bc9e6f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.444782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902d1f8-ddaa-4933-ae23-941947bc9e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.445568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902d1f8-ddaa-4933-ae23-941947bc9e6f None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.446488 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902d1f8-ddaa-4933-ae23-941947bc9e6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:37.446772 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902d1f8-ddaa-4933-ae23-941947bc9e6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:37.448231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902d1f8-ddaa-4933-ae23-941947bc9e6f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:37.453111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:37.467478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 292/566] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Aug 31 00:55:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:37.468778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41942-ad7f-4d00-a489-a9990af94c26 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.469072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41942-ad7f-4d00-a489-a9990af94c26 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.469351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41942-ad7f-4d00-a489-a9990af94c26 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.472713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 293/567] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:37.472713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41942-ad7f-4d00-a489-a9990af94c26 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:37.475662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:37.514787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1fcf9-7913-401b-a3f8-d4b039788c11 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:37.549425 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e913b5e-4ff3-41c7-b874-60f6f37292ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:37.550152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e913b5e-4ff3-41c7-b874-60f6f37292ef None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.550338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e913b5e-4ff3-41c7-b874-60f6f37292ef None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.550612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e913b5e-4ff3-41c7-b874-60f6f37292ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.561353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e913b5e-4ff3-41c7-b874-60f6f37292ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-8e913b5e-4ff3-41c7-b874-60f6f37292ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:37.566566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:37.567648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:37.568518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 275/568] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:37.569242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e913b5e-4ff3-41c7-b874-60f6f37292ef None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:37.579709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41942-ad7f-4d00-a489-a9990af94c26 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:37.613932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae20bf0-6173-4ddb-b9ee-366cb9e7d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:37.614542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae20bf0-6173-4ddb-b9ee-366cb9e7d745 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.614818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae20bf0-6173-4ddb-b9ee-366cb9e7d745 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.615087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae20bf0-6173-4ddb-b9ee-366cb9e7d745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.671657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e913b5e-4ff3-41c7-b874-60f6f37292ef None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:37.673222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:37.683450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae20bf0-6173-4ddb-b9ee-366cb9e7d745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:37.684923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae20bf0-6173-4ddb-b9ee-366cb9e7d745 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:37.687516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:37.709216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cca30-eabf-42f1-9c95-7d06cf7794f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:37.709754 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cca30-eabf-42f1-9c95-7d06cf7794f6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.710042 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cca30-eabf-42f1-9c95-7d06cf7794f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.710327 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cca30-eabf-42f1-9c95-7d06cf7794f6 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.711103 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cca30-eabf-42f1-9c95-7d06cf7794f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:37.711416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cca30-eabf-42f1-9c95-7d06cf7794f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:37.712898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cca30-eabf-42f1-9c95-7d06cf7794f6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:37.731161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 276/569] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Aug 31 00:55:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:37.732015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cca30-eabf-42f1-9c95-7d06cf7794f6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:37.797838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 294/570] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:37.799288 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba5ff5-0ba6-4088-bb9e-345e139e2f59 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.799576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba5ff5-0ba6-4088-bb9e-345e139e2f59 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.799851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba5ff5-0ba6-4088-bb9e-345e139e2f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.818005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bfba5ff5-0ba6-4088-bb9e-345e139e2f59 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:37.819202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bfba5ff5-0ba6-4088-bb9e-345e139e2f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:37.837740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cca30-eabf-42f1-9c95-7d06cf7794f6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:37.874401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345579d4-0f2d-47e6-b12c-126983bc76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:37.875037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345579d4-0f2d-47e6-b12c-126983bc76c1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:37.875319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345579d4-0f2d-47e6-b12c-126983bc76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:37.875616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345579d4-0f2d-47e6-b12c-126983bc76c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:37.888501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345579d4-0f2d-47e6-b12c-126983bc76c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:37.889521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345579d4-0f2d-47e6-b12c-126983bc76c1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:37.890512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 295/571] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:37.891367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba5ff5-0ba6-4088-bb9e-345e139e2f59 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-345579d4-0f2d-47e6-b12c-126983bc76c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:37.922250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:37.923462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:37.924400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:37.924400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:37.924400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:37.924400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 277/572] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:37.924720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345579d4-0f2d-47e6-b12c-126983bc76c1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:37.931342 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:37.941978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:38.012685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba5ff5-0ba6-4088-bb9e-345e139e2f59 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.035911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345579d4-0f2d-47e6-b12c-126983bc76c1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.051170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfcaf2-e0d4-420a-90f5-2612b640ab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.052116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfcaf2-e0d4-420a-90f5-2612b640ab1d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.052498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfcaf2-e0d4-420a-90f5-2612b640ab1d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.052776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfcaf2-e0d4-420a-90f5-2612b640ab1d None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.053451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfcaf2-e0d4-420a-90f5-2612b640ab1d None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:38.053753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfcaf2-e0d4-420a-90f5-2612b640ab1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.055229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfcaf2-e0d4-420a-90f5-2612b640ab1d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.067850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 296/573] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:38.067850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfcaf2-e0d4-420a-90f5-2612b640ab1d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.079143 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa46a8b-6df6-4c0c-b097-aa626e23c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.079787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa46a8b-6df6-4c0c-b097-aa626e23c872 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.080079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa46a8b-6df6-4c0c-b097-aa626e23c872 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.080387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa46a8b-6df6-4c0c-b097-aa626e23c872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.092207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa46a8b-6df6-4c0c-b097-aa626e23c872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.093725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa46a8b-6df6-4c0c-b097-aa626e23c872 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-6aa46a8b-6df6-4c0c-b097-aa626e23c872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:38.109091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:38.110076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:38.110994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:38.110994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:38.110994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:38.110994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 278/574] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:38.110994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa46a8b-6df6-4c0c-b097-aa626e23c872 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.174820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:38.182262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfcaf2-e0d4-420a-90f5-2612b640ab1d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.189459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:38.222881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f04d1-3ed0-4ace-9c9c-939400fad3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.223520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f04d1-3ed0-4ace-9c9c-939400fad3ee None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.223811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f04d1-3ed0-4ace-9c9c-939400fad3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.224082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f04d1-3ed0-4ace-9c9c-939400fad3ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.235697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f04d1-3ed0-4ace-9c9c-939400fad3ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.237187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f04d1-3ed0-4ace-9c9c-939400fad3ee None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.239663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa46a8b-6df6-4c0c-b097-aa626e23c872 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-7f0f04d1-3ed0-4ace-9c9c-939400fad3ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:38.252535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:38.253732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:38.254689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:38.254689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:38.254689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:38.254689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 297/575] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:38.254689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f04d1-3ed0-4ace-9c9c-939400fad3ee None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.279404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c94044-4a5f-425d-9927-75810b01f58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.279920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c94044-4a5f-425d-9927-75810b01f58d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.280197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c94044-4a5f-425d-9927-75810b01f58d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.280527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c94044-4a5f-425d-9927-75810b01f58d None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.281184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c94044-4a5f-425d-9927-75810b01f58d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:38.281493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c94044-4a5f-425d-9927-75810b01f58d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.282890 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c94044-4a5f-425d-9927-75810b01f58d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.297577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 279/576] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:38.298436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c94044-4a5f-425d-9927-75810b01f58d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.365927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f04d1-3ed0-4ace-9c9c-939400fad3ee None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.406226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1c98f-05b3-4d60-a806-80314ace62ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.407117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c98f-05b3-4d60-a806-80314ace62ff None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.407514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c98f-05b3-4d60-a806-80314ace62ff None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.407929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c98f-05b3-4d60-a806-80314ace62ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.410981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c94044-4a5f-425d-9927-75810b01f58d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.423938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1c98f-05b3-4d60-a806-80314ace62ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.425587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1c98f-05b3-4d60-a806-80314ace62ff None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.438170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:38.439565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a3e1c98f-05b3-4d60-a806-80314ace62ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:38.445020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:38.446719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:38.447603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:38.447603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:38.447603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:38.447603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 298/577] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:38.447823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1c98f-05b3-4d60-a806-80314ace62ff None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.457771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c004f-6c30-46ab-91ec-1fe9ec0dc598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.458398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c004f-6c30-46ab-91ec-1fe9ec0dc598 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.458677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c004f-6c30-46ab-91ec-1fe9ec0dc598 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.458952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c004f-6c30-46ab-91ec-1fe9ec0dc598 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.459607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c004f-6c30-46ab-91ec-1fe9ec0dc598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:38.459915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c004f-6c30-46ab-91ec-1fe9ec0dc598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.461598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c004f-6c30-46ab-91ec-1fe9ec0dc598 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.473984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 280/578] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:38.474843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c004f-6c30-46ab-91ec-1fe9ec0dc598 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.580412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1c98f-05b3-4d60-a806-80314ace62ff None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.595964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c004f-6c30-46ab-91ec-1fe9ec0dc598 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.615609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602db908-20cc-4017-8b22-afdd64f5a578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.616247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602db908-20cc-4017-8b22-afdd64f5a578 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.616655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602db908-20cc-4017-8b22-afdd64f5a578 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.617447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602db908-20cc-4017-8b22-afdd64f5a578 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.628897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602db908-20cc-4017-8b22-afdd64f5a578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:38.633747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15474249-723c-46ee-a775-e369c0bd3fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.634375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15474249-723c-46ee-a775-e369c0bd3fde None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.634658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15474249-723c-46ee-a775-e369c0bd3fde None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.634932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15474249-723c-46ee-a775-e369c0bd3fde None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-602db908-20cc-4017-8b22-afdd64f5a578 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:38.635275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:38.636870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:38.638298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:38.638955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15474249-723c-46ee-a775-e369c0bd3fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:38.638955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15474249-723c-46ee-a775-e369c0bd3fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.639103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 299/579] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:38.639103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602db908-20cc-4017-8b22-afdd64f5a578 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.639238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15474249-723c-46ee-a775-e369c0bd3fde None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.650265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 281/580] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:38.651127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15474249-723c-46ee-a775-e369c0bd3fde None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.698576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:38.708864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:38.753480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602db908-20cc-4017-8b22-afdd64f5a578 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.756528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15474249-723c-46ee-a775-e369c0bd3fde None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.787510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ccd31-a24e-4c04-939d-62edc85f2b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.788146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ccd31-a24e-4c04-939d-62edc85f2b86 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.788463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ccd31-a24e-4c04-939d-62edc85f2b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.789248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ccd31-a24e-4c04-939d-62edc85f2b86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.791387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357f191-bce7-4807-9215-c7d07fc3b34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.791996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357f191-bce7-4807-9215-c7d07fc3b34e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.792277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357f191-bce7-4807-9215-c7d07fc3b34e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.792584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357f191-bce7-4807-9215-c7d07fc3b34e None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.793225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357f191-bce7-4807-9215-c7d07fc3b34e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:38.793529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357f191-bce7-4807-9215-c7d07fc3b34e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.794885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357f191-bce7-4807-9215-c7d07fc3b34e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.796085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ccd31-a24e-4c04-939d-62edc85f2b86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.797554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ccd31-a24e-4c04-939d-62edc85f2b86 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.806791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 282/581] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:38.807615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357f191-bce7-4807-9215-c7d07fc3b34e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d49ccd31-a24e-4c04-939d-62edc85f2b86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:38.809545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:38.810376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:38.812060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:38.812060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:38.812060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:38.812060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:38.812060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:38.812060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:38.812060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:38.812060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:38.812060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 300/582] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:38.812060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ccd31-a24e-4c04-939d-62edc85f2b86 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.916386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357f191-bce7-4807-9215-c7d07fc3b34e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.919394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ccd31-a24e-4c04-939d-62edc85f2b86 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:38.919993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:38.951518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:38.958135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c8f3d-88d6-48ed-94c7-96fdc5c5c0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.958799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c8f3d-88d6-48ed-94c7-96fdc5c5c0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.959076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c8f3d-88d6-48ed-94c7-96fdc5c5c0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.959342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c8f3d-88d6-48ed-94c7-96fdc5c5c0c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.960981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255204d2-07a0-47cc-b8e5-997d9753336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:38.961907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255204d2-07a0-47cc-b8e5-997d9753336d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:38.962312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255204d2-07a0-47cc-b8e5-997d9753336d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:38.962592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255204d2-07a0-47cc-b8e5-997d9753336d None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:38.963273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255204d2-07a0-47cc-b8e5-997d9753336d None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:38.963582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255204d2-07a0-47cc-b8e5-997d9753336d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.964995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255204d2-07a0-47cc-b8e5-997d9753336d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.966898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c8f3d-88d6-48ed-94c7-96fdc5c5c0c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:38.968406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c8f3d-88d6-48ed-94c7-96fdc5c5c0c0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:38.974229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 301/583] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:38.975309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255204d2-07a0-47cc-b8e5-997d9753336d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-820c8f3d-88d6-48ed-94c7-96fdc5c5c0c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:38.980633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:38.981673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:38.982577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:38.982577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:38.982577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:38.982577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:38.982577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:38.982577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:38.982577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:38.982577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:38.982577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 283/584] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:38.983068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c8f3d-88d6-48ed-94c7-96fdc5c5c0c0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:39.092664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c8f3d-88d6-48ed-94c7-96fdc5c5c0c0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:39.123069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255204d2-07a0-47cc-b8e5-997d9753336d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:39.132219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2efa6-c0a6-462e-990f-8754730b17e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:39.132938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2efa6-c0a6-462e-990f-8754730b17e3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:39.133223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2efa6-c0a6-462e-990f-8754730b17e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:39.133609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2efa6-c0a6-462e-990f-8754730b17e3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:39.141870 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2efa6-c0a6-462e-990f-8754730b17e3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:39.143331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2efa6-c0a6-462e-990f-8754730b17e3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-aef2efa6-c0a6-462e-990f-8754730b17e3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:39.156370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:39.158075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 284/585] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:39.159984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2efa6-c0a6-462e-990f-8754730b17e3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:39.172271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235403ec-6dba-45ee-a2f2-25f358fbcca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:39.172879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235403ec-6dba-45ee-a2f2-25f358fbcca4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:39.173174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235403ec-6dba-45ee-a2f2-25f358fbcca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:39.173451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235403ec-6dba-45ee-a2f2-25f358fbcca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:39.180412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235403ec-6dba-45ee-a2f2-25f358fbcca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:39.181860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235403ec-6dba-45ee-a2f2-25f358fbcca4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:39.187245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-235403ec-6dba-45ee-a2f2-25f358fbcca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:39.193233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:39.194332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:39.200462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:39.200462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:39.200462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:39.200462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:39.200462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:39.200462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:39.200462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:39.200462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:39.200462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 302/586] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:39.200462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235403ec-6dba-45ee-a2f2-25f358fbcca4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:39.251468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:39.267895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2efa6-c0a6-462e-990f-8754730b17e3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:39.303995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2ead4-3fe0-43cd-8169-85dae6df8a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:39.304637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ead4-3fe0-43cd-8169-85dae6df8a65 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:39.304917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ead4-3fe0-43cd-8169-85dae6df8a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:39.305187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ead4-3fe0-43cd-8169-85dae6df8a65 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:39.305874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2ead4-3fe0-43cd-8169-85dae6df8a65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:39.306179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2ead4-3fe0-43cd-8169-85dae6df8a65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:39.307611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2ead4-3fe0-43cd-8169-85dae6df8a65 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:39.309259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235403ec-6dba-45ee-a2f2-25f358fbcca4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:39.319561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 285/587] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:39.320470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2ead4-3fe0-43cd-8169-85dae6df8a65 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:39.344378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8709af-eb9c-49ec-bc52-5f5e6d39c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:39.345024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8709af-eb9c-49ec-bc52-5f5e6d39c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:39.345327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8709af-eb9c-49ec-bc52-5f5e6d39c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:39.345604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8709af-eb9c-49ec-bc52-5f5e6d39c1b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:39.357567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8709af-eb9c-49ec-bc52-5f5e6d39c1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:39.359179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8709af-eb9c-49ec-bc52-5f5e6d39c1b7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8e8709af-eb9c-49ec-bc52-5f5e6d39c1b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:39.374030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:39.375297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:39.376352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:39.376352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:39.376352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:39.376352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 303/588] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:39.376352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8709af-eb9c-49ec-bc52-5f5e6d39c1b7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:39.412521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:39.430086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2ead4-3fe0-43cd-8169-85dae6df8a65 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:39.466281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19d4c1-699e-46cf-8f6b-69478207fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:39.467173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19d4c1-699e-46cf-8f6b-69478207fa6c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:39.467470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19d4c1-699e-46cf-8f6b-69478207fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:39.467738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19d4c1-699e-46cf-8f6b-69478207fa6c None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:39.468473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19d4c1-699e-46cf-8f6b-69478207fa6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:39.468789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19d4c1-699e-46cf-8f6b-69478207fa6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:39.470225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19d4c1-699e-46cf-8f6b-69478207fa6c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:39.479014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:39.482436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 286/589] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:39.483431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19d4c1-699e-46cf-8f6b-69478207fa6c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:39.486234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8709af-eb9c-49ec-bc52-5f5e6d39c1b7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:39.528309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdc210-e2ec-4680-a3e1-1d32bdb70a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:39.528950 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdc210-e2ec-4680-a3e1-1d32bdb70a32 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:39.529241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdc210-e2ec-4680-a3e1-1d32bdb70a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:39.529529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdc210-e2ec-4680-a3e1-1d32bdb70a32 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:39.530254 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdc210-e2ec-4680-a3e1-1d32bdb70a32 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:39.530564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdc210-e2ec-4680-a3e1-1d32bdb70a32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:39.532014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdc210-e2ec-4680-a3e1-1d32bdb70a32 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:39.551240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 304/590] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Aug 31 00:55:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:39.552098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdc210-e2ec-4680-a3e1-1d32bdb70a32 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:39.613791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19d4c1-699e-46cf-8f6b-69478207fa6c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:39.654391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c452f5-fdf1-4599-acc4-562b1f409b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:39.655027 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c452f5-fdf1-4599-acc4-562b1f409b6e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:39.655313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c452f5-fdf1-4599-acc4-562b1f409b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:39.655588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c452f5-fdf1-4599-acc4-562b1f409b6e None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:39.656745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c452f5-fdf1-4599-acc4-562b1f409b6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:39.657060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c452f5-fdf1-4599-acc4-562b1f409b6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:39.659137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c452f5-fdf1-4599-acc4-562b1f409b6e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:39.674070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 287/591] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:39.674952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c452f5-fdf1-4599-acc4-562b1f409b6e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:39.679876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:39.699044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdc210-e2ec-4680-a3e1-1d32bdb70a32 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:39.747803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7bfb4-c187-4a8d-b58e-06e2fc2bcbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:39.748978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7bfb4-c187-4a8d-b58e-06e2fc2bcbc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:39.749255 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7bfb4-c187-4a8d-b58e-06e2fc2bcbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:39.749526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7bfb4-c187-4a8d-b58e-06e2fc2bcbc5 None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/deb70dd34dc642cfbb49b4e1a0434399/roles/7953b234543143eab052272480b952ec` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:39.765665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7bfb4-c187-4a8d-b58e-06e2fc2bcbc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=deb70dd34dc642cfbb49b4e1a0434399, role_id=7953b234543143eab052272480b952ec)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:39.767148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7bfb4-c187-4a8d-b58e-06e2fc2bcbc5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:39.780940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 305/592] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:55:39 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/deb70dd34dc642cfbb49b4e1a0434399/roles/7953b234543143eab052272480b952ec => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:55:39.781765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7bfb4-c187-4a8d-b58e-06e2fc2bcbc5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:39.784584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:39.798357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c452f5-fdf1-4599-acc4-562b1f409b6e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:39.852030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e7f59-8fc7-43f1-ae91-6080cd9c9391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:39.852901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e7f59-8fc7-43f1-ae91-6080cd9c9391 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:39.853190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e7f59-8fc7-43f1-ae91-6080cd9c9391 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:39.853474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e7f59-8fc7-43f1-ae91-6080cd9c9391 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:39.854158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e7f59-8fc7-43f1-ae91-6080cd9c9391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:39.854468 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e7f59-8fc7-43f1-ae91-6080cd9c9391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:39.855922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e7f59-8fc7-43f1-ae91-6080cd9c9391 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:39.872021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 288/593] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:39.872992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e7f59-8fc7-43f1-ae91-6080cd9c9391 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:39.962530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7bfb4-c187-4a8d-b58e-06e2fc2bcbc5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:39.975707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:40.021271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6a305-e8f6-45fc-b915-4b333c48346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:40.022750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6a305-e8f6-45fc-b915-4b333c48346b None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:40.023235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6a305-e8f6-45fc-b915-4b333c48346b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:40.023686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6a305-e8f6-45fc-b915-4b333c48346b None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/a99d74d9d72c4fc2a363ce6559e4ddff/roles/7953b234543143eab052272480b952ec` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:40.024227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e7f59-8fc7-43f1-ae91-6080cd9c9391 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:40.041469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6a305-e8f6-45fc-b915-4b333c48346b None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=a99d74d9d72c4fc2a363ce6559e4ddff, role_id=7953b234543143eab052272480b952ec)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:40.042922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6a305-e8f6-45fc-b915-4b333c48346b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:40.059309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 306/594] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:55:39 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/a99d74d9d72c4fc2a363ce6559e4ddff/roles/7953b234543143eab052272480b952ec => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:55:40.066004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6a305-e8f6-45fc-b915-4b333c48346b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:40.074297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e399d0-3562-48e6-b852-fc82f629197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:40.076483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e399d0-3562-48e6-b852-fc82f629197f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:40.077048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e399d0-3562-48e6-b852-fc82f629197f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:40.077506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e399d0-3562-48e6-b852-fc82f629197f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:40.100686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e399d0-3562-48e6-b852-fc82f629197f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:40.104295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e399d0-3562-48e6-b852-fc82f629197f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-43e399d0-3562-48e6-b852-fc82f629197f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:40.134745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:40.135785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:40.136740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:40.136740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:40.136740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:40.144148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 289/595] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:40.150680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e399d0-3562-48e6-b852-fc82f629197f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:40.185497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:40.248629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6a305-e8f6-45fc-b915-4b333c48346b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:40.289336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab3a9c-741e-4261-8c7b-8659d136a640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:40.289961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab3a9c-741e-4261-8c7b-8659d136a640 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:40.290250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab3a9c-741e-4261-8c7b-8659d136a640 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:40.290533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab3a9c-741e-4261-8c7b-8659d136a640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:40.291276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab3a9c-741e-4261-8c7b-8659d136a640 None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=814473b735314e4cb2321e952777031c) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:40.291589 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab3a9c-741e-4261-8c7b-8659d136a640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:40.293075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab3a9c-741e-4261-8c7b-8659d136a640 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:40.299562 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 307/596] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:40 2022] GET /identity/v3/role_assignments?user.id=814473b735314e4cb2321e952777031c&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:40.299732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab3a9c-741e-4261-8c7b-8659d136a640 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:40.319873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e399d0-3562-48e6-b852-fc82f629197f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:40.352016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:40.375841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda5786-3a3f-4eff-8b1a-2a446077fed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:40.376549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda5786-3a3f-4eff-8b1a-2a446077fed9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:40.376911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda5786-3a3f-4eff-8b1a-2a446077fed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:40.377203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda5786-3a3f-4eff-8b1a-2a446077fed9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:40.399155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda5786-3a3f-4eff-8b1a-2a446077fed9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:40.400816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda5786-3a3f-4eff-8b1a-2a446077fed9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7cda5786-3a3f-4eff-8b1a-2a446077fed9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:40.426474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:40.427586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:40.428521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 290/597] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:40.434695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda5786-3a3f-4eff-8b1a-2a446077fed9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:40.452148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab3a9c-741e-4261-8c7b-8659d136a640 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:40.492368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:40.515002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b426d58-c1c1-4c95-a374-7cd724ef8a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:40.515545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b426d58-c1c1-4c95-a374-7cd724ef8a5e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:40.515831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b426d58-c1c1-4c95-a374-7cd724ef8a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:40.516108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b426d58-c1c1-4c95-a374-7cd724ef8a5e None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:40.516798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b426d58-c1c1-4c95-a374-7cd724ef8a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:40.517108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b426d58-c1c1-4c95-a374-7cd724ef8a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:40.518661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b426d58-c1c1-4c95-a374-7cd724ef8a5e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:40.533172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 308/598] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:40.538873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b426d58-c1c1-4c95-a374-7cd724ef8a5e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:40.637810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda5786-3a3f-4eff-8b1a-2a446077fed9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:40.692998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b426d58-c1c1-4c95-a374-7cd724ef8a5e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:40.707920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e387020-3d12-4bdb-99e6-866359617370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:40.708577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e387020-3d12-4bdb-99e6-866359617370 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:40.708856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e387020-3d12-4bdb-99e6-866359617370 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:40.709126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e387020-3d12-4bdb-99e6-866359617370 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:40.709867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e387020-3d12-4bdb-99e6-866359617370 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:40.710173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e387020-3d12-4bdb-99e6-866359617370 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:40.712011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e387020-3d12-4bdb-99e6-866359617370 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:40.732788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed433773-bc3e-4213-b226-24cf1167c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:40.740442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed433773-bc3e-4213-b226-24cf1167c309 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:40.740787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed433773-bc3e-4213-b226-24cf1167c309 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:40.741137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed433773-bc3e-4213-b226-24cf1167c309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:40.743881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 291/599] 10.222.0.83 () {56 vars in 1139 bytes} [Wed Aug 31 00:55:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:40.749296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e387020-3d12-4bdb-99e6-866359617370 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:40.750813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed433773-bc3e-4213-b226-24cf1167c309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:40.752384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed433773-bc3e-4213-b226-24cf1167c309 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ed433773-bc3e-4213-b226-24cf1167c309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:40.766605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:40.769956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:40.773458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:40.773458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:40.773458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:40.773458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:40.773458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:40.773458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:40.773458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:40.773458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:40.773458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 309/600] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:40.775443 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed433773-bc3e-4213-b226-24cf1167c309 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:40.810916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:40.847409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:40.909377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed433773-bc3e-4213-b226-24cf1167c309 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:40.946077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d918a-a9e4-44da-9e3e-a56106b1b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:40.946768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d918a-a9e4-44da-9e3e-a56106b1b05f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:40.947180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d918a-a9e4-44da-9e3e-a56106b1b05f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:40.947438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d918a-a9e4-44da-9e3e-a56106b1b05f None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:40.948224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d918a-a9e4-44da-9e3e-a56106b1b05f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:40.948568 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e387020-3d12-4bdb-99e6-866359617370 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:40.948849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d918a-a9e4-44da-9e3e-a56106b1b05f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:40.950354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d918a-a9e4-44da-9e3e-a56106b1b05f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:40.963362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 310/601] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:40.981383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d918a-a9e4-44da-9e3e-a56106b1b05f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:40.999394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feb6bc-a7d5-4872-920c-29bee538fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:41.000074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feb6bc-a7d5-4872-920c-29bee538fd51 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:41.000955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feb6bc-a7d5-4872-920c-29bee538fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:41.000955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feb6bc-a7d5-4872-920c-29bee538fd51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:41.027494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feb6bc-a7d5-4872-920c-29bee538fd51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:41.032529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feb6bc-a7d5-4872-920c-29bee538fd51 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c0feb6bc-a7d5-4872-920c-29bee538fd51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:41.076075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:41.079549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:41.082948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:41.082948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:41.082948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:41.082948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 292/602] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:41.089824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feb6bc-a7d5-4872-920c-29bee538fd51 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:41.231669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:41.243233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d918a-a9e4-44da-9e3e-a56106b1b05f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:41.261660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:41.280801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feb6bc-a7d5-4872-920c-29bee538fd51 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:41.313673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371245-0e56-421f-80f8-66a4286a2ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:41.314360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371245-0e56-421f-80f8-66a4286a2ad0 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:41.314647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371245-0e56-421f-80f8-66a4286a2ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:41.314925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371245-0e56-421f-80f8-66a4286a2ad0 None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/376dd413b33c4f4987f6bba3b14f3bd1/roles/7953b234543143eab052272480b952ec` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:41.324432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c532c-ab39-420c-a300-739c32c94a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:41.325492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c532c-ab39-420c-a300-739c32c94a4c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:41.325995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c532c-ab39-420c-a300-739c32c94a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:41.326490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c532c-ab39-420c-a300-739c32c94a4c None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:41.327701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c532c-ab39-420c-a300-739c32c94a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:41.328265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c532c-ab39-420c-a300-739c32c94a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:41.331070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c532c-ab39-420c-a300-739c32c94a4c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:41.349387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 293/603] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:41.353851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d371245-0e56-421f-80f8-66a4286a2ad0 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=376dd413b33c4f4987f6bba3b14f3bd1, role_id=7953b234543143eab052272480b952ec)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:41.355288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c532c-ab39-420c-a300-739c32c94a4c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:41.355416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d371245-0e56-421f-80f8-66a4286a2ad0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:41.390493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 311/604] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:55:40 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/376dd413b33c4f4987f6bba3b14f3bd1/roles/7953b234543143eab052272480b952ec => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:55:41.533005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c532c-ab39-420c-a300-739c32c94a4c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:41.593617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b9071-c557-43ad-85be-cd2336ddf360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:41.594268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b9071-c557-43ad-85be-cd2336ddf360 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:41.594552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b9071-c557-43ad-85be-cd2336ddf360 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:41.594865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b9071-c557-43ad-85be-cd2336ddf360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:41.606837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b9071-c557-43ad-85be-cd2336ddf360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:41.608303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b9071-c557-43ad-85be-cd2336ddf360 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b59b9071-c557-43ad-85be-cd2336ddf360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:41.630737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:41.631683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:41.633260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:41.633260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:41.633260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:41.633260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:41.633260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:41.633260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:41.633260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:41.633260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:41.633260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 294/605] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:41.641540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371245-0e56-421f-80f8-66a4286a2ad0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:41.791953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371245-0e56-421f-80f8-66a4286a2ad0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:41.830914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277101f4-71b4-4c88-9727-cbffce57252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:41.831529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277101f4-71b4-4c88-9727-cbffce57252a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:41.831810 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277101f4-71b4-4c88-9727-cbffce57252a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:41.832084 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277101f4-71b4-4c88-9727-cbffce57252a None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:41.832805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277101f4-71b4-4c88-9727-cbffce57252a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:41.833109 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277101f4-71b4-4c88-9727-cbffce57252a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:41.834531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277101f4-71b4-4c88-9727-cbffce57252a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:41.847840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 312/606] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:41.853708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b9071-c557-43ad-85be-cd2336ddf360 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:41.870891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:42.041125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b9071-c557-43ad-85be-cd2336ddf360 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:42.071819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6e0de-76ae-47a5-99c5-2355a96971c5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:42.072010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6e0de-76ae-47a5-99c5-2355a96971c5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:42.072290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6e0de-76ae-47a5-99c5-2355a96971c5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:42.073891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 313/607] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:42.079076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7627d-eb95-4f2d-b6f2-b14b655d85ef None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:42.079348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7627d-eb95-4f2d-b6f2-b14b655d85ef None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:42.079624 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7627d-eb95-4f2d-b6f2-b14b655d85ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:42.092503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:42.098278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6cc7627d-eb95-4f2d-b6f2-b14b655d85ef None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:42.099547 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6cc7627d-eb95-4f2d-b6f2-b14b655d85ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:42.101782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71560b-685f-4dc2-a55b-e7d042f9b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:42.102370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71560b-685f-4dc2-a55b-e7d042f9b37f None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:42.102660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71560b-685f-4dc2-a55b-e7d042f9b37f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:42.102943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71560b-685f-4dc2-a55b-e7d042f9b37f None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/f6c13711596647178ad3f93865eca187/roles/7953b234543143eab052272480b952ec` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:42.131920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71560b-685f-4dc2-a55b-e7d042f9b37f None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=f6c13711596647178ad3f93865eca187, role_id=7953b234543143eab052272480b952ec)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:42.134555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71560b-685f-4dc2-a55b-e7d042f9b37f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:42.160542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 295/608] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:55:41 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/f6c13711596647178ad3f93865eca187/roles/7953b234543143eab052272480b952ec => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:55:42.222360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 314/609] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:42.517098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71560b-685f-4dc2-a55b-e7d042f9b37f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:42.584293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:42.634517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71560b-685f-4dc2-a55b-e7d042f9b37f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:42.674322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e5628-7ee0-4a5c-87b2-89958adb4e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:42.674970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e5628-7ee0-4a5c-87b2-89958adb4e94 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:42.675250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e5628-7ee0-4a5c-87b2-89958adb4e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:42.675524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e5628-7ee0-4a5c-87b2-89958adb4e94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:42.687426 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e5628-7ee0-4a5c-87b2-89958adb4e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-a26e5628-7ee0-4a5c-87b2-89958adb4e94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:42.692252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:42.693232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:42.694070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 296/610] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:42.699537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7627d-eb95-4f2d-b6f2-b14b655d85ef None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:42.713351 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8018881-6523-4f68-8abe-a95d3a3d1e9d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:42.713671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8018881-6523-4f68-8abe-a95d3a3d1e9d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:42.713924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8018881-6523-4f68-8abe-a95d3a3d1e9d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:42.715652 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 297/611] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:42.733910 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b092f-213c-4d7e-a538-2422bf7c1544 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:42.734234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b092f-213c-4d7e-a538-2422bf7c1544 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:42.734472 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b092f-213c-4d7e-a538-2422bf7c1544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:42.755769 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-465b092f-213c-4d7e-a538-2422bf7c1544 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:42.757006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-465b092f-213c-4d7e-a538-2422bf7c1544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:42.841065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 298/612] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:42.922794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc518-ee1c-4060-a7dc-ac3d205fa12e None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:42.923015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7627d-eb95-4f2d-b6f2-b14b655d85ef None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:42.923432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc518-ee1c-4060-a7dc-ac3d205fa12e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:42.923432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc518-ee1c-4060-a7dc-ac3d205fa12e None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:42.925105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 299/613] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:42.934748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8736e-4725-4ff4-a9fc-90e558eef605 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:42.935172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8736e-4725-4ff4-a9fc-90e558eef605 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:42.935952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8736e-4725-4ff4-a9fc-90e558eef605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:42.960291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-13a8736e-4725-4ff4-a9fc-90e558eef605 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:42.962065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-13a8736e-4725-4ff4-a9fc-90e558eef605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:42.977750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1a12b-b98b-44ff-8837-34a2733fc785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:42.978381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1a12b-b98b-44ff-8837-34a2733fc785 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:42.978667 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1a12b-b98b-44ff-8837-34a2733fc785 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:42.978942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1a12b-b98b-44ff-8837-34a2733fc785 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:42.979617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1a12b-b98b-44ff-8837-34a2733fc785 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:42.979925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1a12b-b98b-44ff-8837-34a2733fc785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:42.981320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1a12b-b98b-44ff-8837-34a2733fc785 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:42.985723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:42.999737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 315/614] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:43.009355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1a12b-b98b-44ff-8837-34a2733fc785 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:43.021869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:43.046825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 300/615] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:43.199999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8736e-4725-4ff4-a9fc-90e558eef605 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:43.212635 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1a12b-b98b-44ff-8837-34a2733fc785 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:43.318248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b281fc-b60d-4c4c-8b35-398f53f03b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:43.319259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b281fc-b60d-4c4c-8b35-398f53f03b2e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:43.319781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b281fc-b60d-4c4c-8b35-398f53f03b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:43.320269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b281fc-b60d-4c4c-8b35-398f53f03b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:43.320840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8736e-4725-4ff4-a9fc-90e558eef605 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:43.357556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329eb6-f16a-4a48-af1e-ccc4460bcbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:43.358196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329eb6-f16a-4a48-af1e-ccc4460bcbec None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:43.358481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329eb6-f16a-4a48-af1e-ccc4460bcbec None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:43.359302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329eb6-f16a-4a48-af1e-ccc4460bcbec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:43.369634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b281fc-b60d-4c4c-8b35-398f53f03b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:43.370800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32329eb6-f16a-4a48-af1e-ccc4460bcbec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:43.372232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b281fc-b60d-4c4c-8b35-398f53f03b2e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-32329eb6-f16a-4a48-af1e-ccc4460bcbec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:43.375579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:43.376560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:43.377406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 301/616] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:43.378099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329eb6-f16a-4a48-af1e-ccc4460bcbec None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f5b281fc-b60d-4c4c-8b35-398f53f03b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:43.400058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:43.401295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:43.402202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:43.402202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:43.402202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:43.402202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 316/617] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:43.402425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b281fc-b60d-4c4c-8b35-398f53f03b2e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:43.430672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:43.471313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:43.509962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329eb6-f16a-4a48-af1e-ccc4460bcbec None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:43.539478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b281fc-b60d-4c4c-8b35-398f53f03b2e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:43.550261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c508-cedf-4113-bcce-3b2305a568c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:43.551372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c508-cedf-4113-bcce-3b2305a568c9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:43.551869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c508-cedf-4113-bcce-3b2305a568c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:43.552491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c508-cedf-4113-bcce-3b2305a568c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:43.565419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065c508-cedf-4113-bcce-3b2305a568c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4065c508-cedf-4113-bcce-3b2305a568c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:43.571529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:43.572523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:43.573352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:43.580771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 302/618] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:43.582230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c508-cedf-4113-bcce-3b2305a568c9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:43.584262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56734a1e-76fc-4e5c-b39a-0c091a9da154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:43.585690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56734a1e-76fc-4e5c-b39a-0c091a9da154 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:43.586215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56734a1e-76fc-4e5c-b39a-0c091a9da154 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:43.586781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56734a1e-76fc-4e5c-b39a-0c091a9da154 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:43.587887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56734a1e-76fc-4e5c-b39a-0c091a9da154 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:43.588362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56734a1e-76fc-4e5c-b39a-0c091a9da154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:43.590955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56734a1e-76fc-4e5c-b39a-0c091a9da154 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:43.603333 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 317/619] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:43.604457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56734a1e-76fc-4e5c-b39a-0c091a9da154 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:43.697053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:43.705146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c508-cedf-4113-bcce-3b2305a568c9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:43.723492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56734a1e-76fc-4e5c-b39a-0c091a9da154 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:43.739570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:43.747348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cee11-121d-463f-8bc0-42611325503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:43.748115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cee11-121d-463f-8bc0-42611325503b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:43.748530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cee11-121d-463f-8bc0-42611325503b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:43.748908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cee11-121d-463f-8bc0-42611325503b None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:43.749674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cee11-121d-463f-8bc0-42611325503b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:43.750101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cee11-121d-463f-8bc0-42611325503b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:43.751683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cee11-121d-463f-8bc0-42611325503b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:43.765529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7a832-7289-4a19-b108-0c3ce5fb971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:43.766408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7a832-7289-4a19-b108-0c3ce5fb971f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:43.766844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7a832-7289-4a19-b108-0c3ce5fb971f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:43.767339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7a832-7289-4a19-b108-0c3ce5fb971f None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:43.768360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7a832-7289-4a19-b108-0c3ce5fb971f None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:43.768892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7a832-7289-4a19-b108-0c3ce5fb971f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:43.770510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7a832-7289-4a19-b108-0c3ce5fb971f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:43.771431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 303/620] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:43.772505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cee11-121d-463f-8bc0-42611325503b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:43.780920 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 318/621] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:43.782068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7a832-7289-4a19-b108-0c3ce5fb971f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:43.889044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7a832-7289-4a19-b108-0c3ce5fb971f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:43.891304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cee11-121d-463f-8bc0-42611325503b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:43.927607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19d4a2-6643-40f8-af4b-ea66a98c581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:43.928244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19d4a2-6643-40f8-af4b-ea66a98c581a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:43.928556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19d4a2-6643-40f8-af4b-ea66a98c581a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:43.928831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19d4a2-6643-40f8-af4b-ea66a98c581a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:43.930860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badd2a0-db66-44d1-8baa-1f44aaa5c2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:43.931655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badd2a0-db66-44d1-8baa-1f44aaa5c2cf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:43.931936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badd2a0-db66-44d1-8baa-1f44aaa5c2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:43.932206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badd2a0-db66-44d1-8baa-1f44aaa5c2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:43.939012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19d4a2-6643-40f8-af4b-ea66a98c581a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:43.940608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19d4a2-6643-40f8-af4b-ea66a98c581a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:43.948081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badd2a0-db66-44d1-8baa-1f44aaa5c2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:43.949796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badd2a0-db66-44d1-8baa-1f44aaa5c2cf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6f19d4a2-6643-40f8-af4b-ea66a98c581a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:43.953835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:43.962744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 319/622] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:43.963806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19d4a2-6643-40f8-af4b-ea66a98c581a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-5badd2a0-db66-44d1-8baa-1f44aaa5c2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:43.971392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:43.972402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:43.973312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:43.973312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:43.973312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:43.973312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 304/623] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:43.974050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e995bb-c457-4712-8679-b486542b2d1c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:43.974333 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e995bb-c457-4712-8679-b486542b2d1c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:43.974607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e995bb-c457-4712-8679-b486542b2d1c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:43.975944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 305/624] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:43.980684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e995bb-c457-4712-8679-b486542b2d1c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:43.991947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:44.003541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:44.077225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19d4a2-6643-40f8-af4b-ea66a98c581a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:44.093604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e995bb-c457-4712-8679-b486542b2d1c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:44.126986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2385ac5-2e3a-4b89-99da-6fff4d19d65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:44.127836 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2385ac5-2e3a-4b89-99da-6fff4d19d65b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.128220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2385ac5-2e3a-4b89-99da-6fff4d19d65b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.128598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2385ac5-2e3a-4b89-99da-6fff4d19d65b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.133414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1402d-1505-4068-b00d-fff257786e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:44.134035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1402d-1505-4068-b00d-fff257786e5c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.134313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1402d-1505-4068-b00d-fff257786e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.134588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1402d-1505-4068-b00d-fff257786e5c None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.135331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1402d-1505-4068-b00d-fff257786e5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:44.135642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1402d-1505-4068-b00d-fff257786e5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:44.137122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1402d-1505-4068-b00d-fff257786e5c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:44.144358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2385ac5-2e3a-4b89-99da-6fff4d19d65b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:44.149075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2385ac5-2e3a-4b89-99da-6fff4d19d65b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:44.158522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 306/625] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Aug 31 00:55:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:44.164286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1402d-1505-4068-b00d-fff257786e5c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c2385ac5-2e3a-4b89-99da-6fff4d19d65b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:44.166587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:44.167513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:44.169086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:44.169086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:44.169086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:44.169086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 320/626] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:44.173277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6062f55-2927-4838-8cd2-9bceed9e06f9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.173570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6062f55-2927-4838-8cd2-9bceed9e06f9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.173849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6062f55-2927-4838-8cd2-9bceed9e06f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.199974 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b6062f55-2927-4838-8cd2-9bceed9e06f9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:44.201124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b6062f55-2927-4838-8cd2-9bceed9e06f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:44.251273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:44.284380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 321/627] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:44.284380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6062f55-2927-4838-8cd2-9bceed9e06f9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:44.309754 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1402d-1505-4068-b00d-fff257786e5c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:44.318463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:44.370271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760148e0-dc42-46d0-9524-a5b8a4bad54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:44.371535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760148e0-dc42-46d0-9524-a5b8a4bad54c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.372377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760148e0-dc42-46d0-9524-a5b8a4bad54c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.373024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760148e0-dc42-46d0-9524-a5b8a4bad54c None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.374402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760148e0-dc42-46d0-9524-a5b8a4bad54c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:44.375131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760148e0-dc42-46d0-9524-a5b8a4bad54c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:44.377765 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760148e0-dc42-46d0-9524-a5b8a4bad54c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:44.404539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 307/628] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:44.406373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760148e0-dc42-46d0-9524-a5b8a4bad54c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:44.456220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6062f55-2927-4838-8cd2-9bceed9e06f9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:44.501484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026e7b1-57d5-4a35-989c-53da93b3140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:44.502462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026e7b1-57d5-4a35-989c-53da93b3140c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.502967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026e7b1-57d5-4a35-989c-53da93b3140c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.503439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026e7b1-57d5-4a35-989c-53da93b3140c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.547354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760148e0-dc42-46d0-9524-a5b8a4bad54c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:44.577142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026e7b1-57d5-4a35-989c-53da93b3140c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:44.578949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026e7b1-57d5-4a35-989c-53da93b3140c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:44.579589 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:44.590752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae5d7f-4300-4ff8-a1d6-0abe94c01b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:44.591667 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae5d7f-4300-4ff8-a1d6-0abe94c01b9a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.592010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae5d7f-4300-4ff8-a1d6-0abe94c01b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.592645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae5d7f-4300-4ff8-a1d6-0abe94c01b9a None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.593123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae5d7f-4300-4ff8-a1d6-0abe94c01b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:44.593431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae5d7f-4300-4ff8-a1d6-0abe94c01b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:44.594931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae5d7f-4300-4ff8-a1d6-0abe94c01b9a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:44.601234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:44.608225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 308/629] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:44.609084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae5d7f-4300-4ff8-a1d6-0abe94c01b9a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:44.698913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 322/630] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:44.700208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad4076-fcd2-4fa8-bf36-959b92b6c395 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.700522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad4076-fcd2-4fa8-bf36-959b92b6c395 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.700893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad4076-fcd2-4fa8-bf36-959b92b6c395 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.702296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 323/631] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:44.703012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad4076-fcd2-4fa8-bf36-959b92b6c395 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:44.725910 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae5d7f-4300-4ff8-a1d6-0abe94c01b9a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:44.760953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1884d-2756-4d24-9a7d-0be5d8e09c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:44.761585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1884d-2756-4d24-9a7d-0be5d8e09c3c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.761867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1884d-2756-4d24-9a7d-0be5d8e09c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.762144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1884d-2756-4d24-9a7d-0be5d8e09c3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.769375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1884d-2756-4d24-9a7d-0be5d8e09c3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:44.770824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1884d-2756-4d24-9a7d-0be5d8e09c3c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-1ee1884d-2756-4d24-9a7d-0be5d8e09c3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:44.782616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:44.783756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 309/632] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Aug 31 00:55:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:44.784743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1884d-2756-4d24-9a7d-0be5d8e09c3c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:44.808899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad4076-fcd2-4fa8-bf36-959b92b6c395 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:44.826274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:44.834476 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:44.845142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c78cd5-31f5-4018-bc23-d83d3a8cfecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:44.845794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c78cd5-31f5-4018-bc23-d83d3a8cfecd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.846037 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c78cd5-31f5-4018-bc23-d83d3a8cfecd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.846304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c78cd5-31f5-4018-bc23-d83d3a8cfecd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.854294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c78cd5-31f5-4018-bc23-d83d3a8cfecd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:44.855732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c78cd5-31f5-4018-bc23-d83d3a8cfecd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-23c78cd5-31f5-4018-bc23-d83d3a8cfecd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:44.867985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:44.869296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:44.870371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 324/633] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:55:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:44.873163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c78cd5-31f5-4018-bc23-d83d3a8cfecd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:44.893632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1884d-2756-4d24-9a7d-0be5d8e09c3c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:44.931161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181084fa-6105-4fb3-91f0-cbc36a6d766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:44.931793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181084fa-6105-4fb3-91f0-cbc36a6d766c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.932077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181084fa-6105-4fb3-91f0-cbc36a6d766c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.932387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181084fa-6105-4fb3-91f0-cbc36a6d766c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.943174 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181084fa-6105-4fb3-91f0-cbc36a6d766c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-181084fa-6105-4fb3-91f0-cbc36a6d766c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:44.949090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:44.950304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:44.951526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 310/634] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:44.952442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f859680-c8de-4255-ab15-c6732b4e59a0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:44.952442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f859680-c8de-4255-ab15-c6732b4e59a0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:44.952442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f859680-c8de-4255-ab15-c6732b4e59a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:44.970675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4f859680-c8de-4255-ab15-c6732b4e59a0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:44.971878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4f859680-c8de-4255-ab15-c6732b4e59a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:44.986599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c78cd5-31f5-4018-bc23-d83d3a8cfecd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:45.020794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb2284-4c87-4f82-8f72-d956162347b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:45.021421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb2284-4c87-4f82-8f72-d956162347b5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:45.021701 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb2284-4c87-4f82-8f72-d956162347b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:45.021974 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb2284-4c87-4f82-8f72-d956162347b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:45.034072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb2284-4c87-4f82-8f72-d956162347b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:45.035521 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb2284-4c87-4f82-8f72-d956162347b5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:45.040665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 311/635] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:45.041495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f859680-c8de-4255-ab15-c6732b4e59a0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b2fb2284-4c87-4f82-8f72-d956162347b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:45.049471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:45.050518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:45.051437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:45.051437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:45.051437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:45.051437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 325/636] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:45.051437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb2284-4c87-4f82-8f72-d956162347b5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.082875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:45.095167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:45.171916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f859680-c8de-4255-ab15-c6732b4e59a0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:45.176027 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb2284-4c87-4f82-8f72-d956162347b5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:45.209858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef048f-c7f0-4459-9a3d-afbc5340722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:45.210497 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef048f-c7f0-4459-9a3d-afbc5340722b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:45.210777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef048f-c7f0-4459-9a3d-afbc5340722b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:45.211047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef048f-c7f0-4459-9a3d-afbc5340722b None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:45.211778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef048f-c7f0-4459-9a3d-afbc5340722b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:45.212146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef048f-c7f0-4459-9a3d-afbc5340722b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:45.213614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef048f-c7f0-4459-9a3d-afbc5340722b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:45.213850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ec484-8ca8-4a85-84d5-8043aa111796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:45.214540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec484-8ca8-4a85-84d5-8043aa111796 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:45.214823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec484-8ca8-4a85-84d5-8043aa111796 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:45.215107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec484-8ca8-4a85-84d5-8043aa111796 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:45.215833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ec484-8ca8-4a85-84d5-8043aa111796 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:45.216148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ec484-8ca8-4a85-84d5-8043aa111796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:45.217925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ec484-8ca8-4a85-84d5-8043aa111796 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:45.232429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 312/637] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:45.233169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef048f-c7f0-4459-9a3d-afbc5340722b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.242894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 326/638] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:45.244493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ec484-8ca8-4a85-84d5-8043aa111796 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.331373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:45.331638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:45.339488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef048f-c7f0-4459-9a3d-afbc5340722b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:45.346658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ec484-8ca8-4a85-84d5-8043aa111796 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:45.373991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec1670-ae08-4782-970d-5c3f52495f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:45.374593 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1670-ae08-4782-970d-5c3f52495f06 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:45.374880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1670-ae08-4782-970d-5c3f52495f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:45.375179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1670-ae08-4782-970d-5c3f52495f06 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:45.375844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec1670-ae08-4782-970d-5c3f52495f06 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:45.376149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec1670-ae08-4782-970d-5c3f52495f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:45.377578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec1670-ae08-4782-970d-5c3f52495f06 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:45.380163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d607d9-92e1-4171-9a93-0e96fba13873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:45.380801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d607d9-92e1-4171-9a93-0e96fba13873 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:45.381088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d607d9-92e1-4171-9a93-0e96fba13873 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:45.381367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d607d9-92e1-4171-9a93-0e96fba13873 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:45.382010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d607d9-92e1-4171-9a93-0e96fba13873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:45.382932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d607d9-92e1-4171-9a93-0e96fba13873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:45.384275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d607d9-92e1-4171-9a93-0e96fba13873 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:45.385881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 313/639] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:45.386673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec1670-ae08-4782-970d-5c3f52495f06 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.400054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 327/640] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:45.400908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d607d9-92e1-4171-9a93-0e96fba13873 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.489512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec1670-ae08-4782-970d-5c3f52495f06 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:45.498238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d607d9-92e1-4171-9a93-0e96fba13873 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:45.529274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26391b3-fbd9-4156-bcda-032b7df78ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:45.529915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26391b3-fbd9-4156-bcda-032b7df78ffc None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:45.530223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26391b3-fbd9-4156-bcda-032b7df78ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:45.530502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26391b3-fbd9-4156-bcda-032b7df78ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:45.534212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc4b35-17a3-4899-a79d-a39987c84e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:45.534927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc4b35-17a3-4899-a79d-a39987c84e67 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:45.536529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc4b35-17a3-4899-a79d-a39987c84e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:45.536529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc4b35-17a3-4899-a79d-a39987c84e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:45.546114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc4b35-17a3-4899-a79d-a39987c84e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:45.547547 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc4b35-17a3-4899-a79d-a39987c84e67 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:45.554016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:45.555290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-45fc4b35-17a3-4899-a79d-a39987c84e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:45.562382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:45.563515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:45.564657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:45.564657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:45.564657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:45.566980 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 328/641] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:45.567773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc4b35-17a3-4899-a79d-a39987c84e67 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.600833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26391b3-fbd9-4156-bcda-032b7df78ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:45.603310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26391b3-fbd9-4156-bcda-032b7df78ffc None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:45.671103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc4b35-17a3-4899-a79d-a39987c84e67 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:45.703070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 314/642] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:45.703917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26391b3-fbd9-4156-bcda-032b7df78ffc None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.705898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcd0b4-1bfe-4ed0-83c8-0db250ed994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:45.706685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcd0b4-1bfe-4ed0-83c8-0db250ed994d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:45.706976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcd0b4-1bfe-4ed0-83c8-0db250ed994d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:45.707253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcd0b4-1bfe-4ed0-83c8-0db250ed994d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:45.717925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcd0b4-1bfe-4ed0-83c8-0db250ed994d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-bbdcd0b4-1bfe-4ed0-83c8-0db250ed994d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:45.723813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:45.724831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 329/643] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:45.725676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcd0b4-1bfe-4ed0-83c8-0db250ed994d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.764288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:45.781470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:45.811120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26391b3-fbd9-4156-bcda-032b7df78ffc None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:45.824452 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcd0b4-1bfe-4ed0-83c8-0db250ed994d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:45.845015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a284b-78e9-4f1c-ab64-2dc01d44fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:45.845640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a284b-78e9-4f1c-ab64-2dc01d44fcba None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:45.845920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a284b-78e9-4f1c-ab64-2dc01d44fcba None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:45.846191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a284b-78e9-4f1c-ab64-2dc01d44fcba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:45.857009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a284b-78e9-4f1c-ab64-2dc01d44fcba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:45.858078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4851d6e-d2d7-4387-b75b-fab282bf5ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:45.858469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a284b-78e9-4f1c-ab64-2dc01d44fcba None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:45.858703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4851d6e-d2d7-4387-b75b-fab282bf5ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:45.858986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4851d6e-d2d7-4387-b75b-fab282bf5ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:45.859263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4851d6e-d2d7-4387-b75b-fab282bf5ae3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:45.865891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4851d6e-d2d7-4387-b75b-fab282bf5ae3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:45.867410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4851d6e-d2d7-4387-b75b-fab282bf5ae3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9b7a284b-78e9-4f1c-ab64-2dc01d44fcba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:45.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:45.874231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:45.875276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:45.875276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:45.875276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:45.876466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 315/644] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:45.877450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a284b-78e9-4f1c-ab64-2dc01d44fcba None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d4851d6e-d2d7-4387-b75b-fab282bf5ae3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:45.878694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:45.879564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:45.880522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:45.880522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:45.880522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:45.880522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:45.880522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:45.880522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:45.880522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:45.880522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:45.880522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 330/645] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:45.881023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4851d6e-d2d7-4387-b75b-fab282bf5ae3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:45.994827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a284b-78e9-4f1c-ab64-2dc01d44fcba None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.004537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:46.012176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4851d6e-d2d7-4387-b75b-fab282bf5ae3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.031219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:46.042797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb498c-335b-4d42-a7c6-cceac89b8330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.043431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb498c-335b-4d42-a7c6-cceac89b8330 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.043715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb498c-335b-4d42-a7c6-cceac89b8330 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.043987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb498c-335b-4d42-a7c6-cceac89b8330 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.044693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb498c-335b-4d42-a7c6-cceac89b8330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:46.044991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb498c-335b-4d42-a7c6-cceac89b8330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.046370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb498c-335b-4d42-a7c6-cceac89b8330 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.052847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ffce1-63d4-4d42-9408-0943ad481b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.053500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ffce1-63d4-4d42-9408-0943ad481b96 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.053783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ffce1-63d4-4d42-9408-0943ad481b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.054090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ffce1-63d4-4d42-9408-0943ad481b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.060462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 316/646] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:46.061314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb498c-335b-4d42-a7c6-cceac89b8330 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.065931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ffce1-63d4-4d42-9408-0943ad481b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.067422 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ffce1-63d4-4d42-9408-0943ad481b96 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5e0ffce1-63d4-4d42-9408-0943ad481b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:46.082731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:46.084480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:46.086091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:46.086091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:46.086091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:46.086091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 331/647] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:46.086091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ffce1-63d4-4d42-9408-0943ad481b96 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.171313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb498c-335b-4d42-a7c6-cceac89b8330 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.203250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ffce1-63d4-4d42-9408-0943ad481b96 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.206416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a783432-8d6e-42a2-9d72-fdd915779eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.207023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a783432-8d6e-42a2-9d72-fdd915779eda None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.207304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a783432-8d6e-42a2-9d72-fdd915779eda None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.207575 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a783432-8d6e-42a2-9d72-fdd915779eda None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.208240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a783432-8d6e-42a2-9d72-fdd915779eda None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:46.208567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a783432-8d6e-42a2-9d72-fdd915779eda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.209933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a783432-8d6e-42a2-9d72-fdd915779eda None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.223344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 317/648] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:46.223344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a783432-8d6e-42a2-9d72-fdd915779eda None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.240453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696afce-2161-43e5-8104-d64ea781288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.241080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696afce-2161-43e5-8104-d64ea781288e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.241418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696afce-2161-43e5-8104-d64ea781288e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.242285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696afce-2161-43e5-8104-d64ea781288e None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.243292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696afce-2161-43e5-8104-d64ea781288e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:46.243610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696afce-2161-43e5-8104-d64ea781288e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.245063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696afce-2161-43e5-8104-d64ea781288e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.252851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:46.262028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 332/649] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:46.262870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696afce-2161-43e5-8104-d64ea781288e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.294159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:46.330671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a783432-8d6e-42a2-9d72-fdd915779eda None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.365163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696afce-2161-43e5-8104-d64ea781288e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.366119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235923-bc2d-49a4-b0aa-52f722739c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.367344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235923-bc2d-49a4-b0aa-52f722739c03 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.367732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235923-bc2d-49a4-b0aa-52f722739c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.368017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235923-bc2d-49a4-b0aa-52f722739c03 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.368751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13235923-bc2d-49a4-b0aa-52f722739c03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:46.369057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13235923-bc2d-49a4-b0aa-52f722739c03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.370499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13235923-bc2d-49a4-b0aa-52f722739c03 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.382807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 318/650] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:46.383660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235923-bc2d-49a4-b0aa-52f722739c03 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.404944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48247c2e-9883-4218-8009-f6ea1346cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.405578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48247c2e-9883-4218-8009-f6ea1346cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.405857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48247c2e-9883-4218-8009-f6ea1346cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.406132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48247c2e-9883-4218-8009-f6ea1346cfb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.412858 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48247c2e-9883-4218-8009-f6ea1346cfb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.414863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48247c2e-9883-4218-8009-f6ea1346cfb4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-48247c2e-9883-4218-8009-f6ea1346cfb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:46.426961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:46.428163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:46.429875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:46.429875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:46.429875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:46.429875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:46.429875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:46.429875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:46.429875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:46.429875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:46.429875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 333/651] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:46.429875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48247c2e-9883-4218-8009-f6ea1346cfb4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.484833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:46.496313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235923-bc2d-49a4-b0aa-52f722739c03 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.523139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:46.530663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ede8e-df78-434a-9541-bf558d7ac141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.531278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ede8e-df78-434a-9541-bf558d7ac141 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.531561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ede8e-df78-434a-9541-bf558d7ac141 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.531842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ede8e-df78-434a-9541-bf558d7ac141 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.532522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ede8e-df78-434a-9541-bf558d7ac141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:46.532830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ede8e-df78-434a-9541-bf558d7ac141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.533556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48247c2e-9883-4218-8009-f6ea1346cfb4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.534202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ede8e-df78-434a-9541-bf558d7ac141 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.546154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 319/652] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:46.546996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ede8e-df78-434a-9541-bf558d7ac141 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.569811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a5945-adfe-4eae-96ab-e29c91c49c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.570442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a5945-adfe-4eae-96ab-e29c91c49c7e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.570718 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a5945-adfe-4eae-96ab-e29c91c49c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.570991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a5945-adfe-4eae-96ab-e29c91c49c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.581162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a5945-adfe-4eae-96ab-e29c91c49c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.582603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a5945-adfe-4eae-96ab-e29c91c49c7e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9b3a5945-adfe-4eae-96ab-e29c91c49c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:46.597943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:46.599216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:46.600315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:46.600315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:46.600315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:46.600315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 334/653] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:46.600315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a5945-adfe-4eae-96ab-e29c91c49c7e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.655606 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ede8e-df78-434a-9541-bf558d7ac141 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.689837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238022e1-ec1a-4a2f-b59b-204e3d8025ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.690476 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238022e1-ec1a-4a2f-b59b-204e3d8025ce None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.690758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238022e1-ec1a-4a2f-b59b-204e3d8025ce None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.691300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238022e1-ec1a-4a2f-b59b-204e3d8025ce None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.699232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238022e1-ec1a-4a2f-b59b-204e3d8025ce None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.700004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a5945-adfe-4eae-96ab-e29c91c49c7e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.700702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238022e1-ec1a-4a2f-b59b-204e3d8025ce None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-238022e1-ec1a-4a2f-b59b-204e3d8025ce None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:46.712375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:46.713438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 320/654] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:46.714409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238022e1-ec1a-4a2f-b59b-204e3d8025ce None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.728645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:46.738751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d69a3-6ed3-4cbc-9f98-b47e5c2c810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.739364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d69a3-6ed3-4cbc-9f98-b47e5c2c810f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.739647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d69a3-6ed3-4cbc-9f98-b47e5c2c810f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.739922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d69a3-6ed3-4cbc-9f98-b47e5c2c810f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.740691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d69a3-6ed3-4cbc-9f98-b47e5c2c810f None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=deb70dd34dc642cfbb49b4e1a0434399) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:46.741008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d69a3-6ed3-4cbc-9f98-b47e5c2c810f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.743363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d69a3-6ed3-4cbc-9f98-b47e5c2c810f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.749453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 335/655] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/role_assignments?user.id=deb70dd34dc642cfbb49b4e1a0434399&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:46.750249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d69a3-6ed3-4cbc-9f98-b47e5c2c810f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.760417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:46.833749 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238022e1-ec1a-4a2f-b59b-204e3d8025ce None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.876989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d69a3-6ed3-4cbc-9f98-b47e5c2c810f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:46.879312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6dbfd-bdcc-4fca-aee3-cdebdd7e5c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.879945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6dbfd-bdcc-4fca-aee3-cdebdd7e5c87 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.880223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6dbfd-bdcc-4fca-aee3-cdebdd7e5c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.880601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6dbfd-bdcc-4fca-aee3-cdebdd7e5c87 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.881312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6dbfd-bdcc-4fca-aee3-cdebdd7e5c87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:46.881621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6dbfd-bdcc-4fca-aee3-cdebdd7e5c87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.883695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6dbfd-bdcc-4fca-aee3-cdebdd7e5c87 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.904062 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 321/656] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:46.904959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6dbfd-bdcc-4fca-aee3-cdebdd7e5c87 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.929966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404e630-70bf-42a8-b883-84a8a21b34a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:46.930633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404e630-70bf-42a8-b883-84a8a21b34a7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:46.930925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404e630-70bf-42a8-b883-84a8a21b34a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:46.931200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404e630-70bf-42a8-b883-84a8a21b34a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:46.939902 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404e630-70bf-42a8-b883-84a8a21b34a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:46.941410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404e630-70bf-42a8-b883-84a8a21b34a7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3404e630-70bf-42a8-b883-84a8a21b34a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:46.955259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:46.956447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:46.958231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:46.958231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:46.958231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:46.958231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:46.958231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:46.958231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:46.958231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:46.958231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:46.958231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 336/657] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:46.958231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404e630-70bf-42a8-b883-84a8a21b34a7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:46.997538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:47.032111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:47.045750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6dbfd-bdcc-4fca-aee3-cdebdd7e5c87 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:47.074922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404e630-70bf-42a8-b883-84a8a21b34a7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:47.083706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a265c11-2503-4f79-b385-afec2c1f0f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:47.084815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a265c11-2503-4f79-b385-afec2c1f0f78 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:47.085049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a265c11-2503-4f79-b385-afec2c1f0f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:47.085371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a265c11-2503-4f79-b385-afec2c1f0f78 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:47.087146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a265c11-2503-4f79-b385-afec2c1f0f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:47.087466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a265c11-2503-4f79-b385-afec2c1f0f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:47.089050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a265c11-2503-4f79-b385-afec2c1f0f78 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:47.106835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 322/658] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:47.107611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a265c11-2503-4f79-b385-afec2c1f0f78 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:47.112066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f46b35-200e-427a-a789-333d70524c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:47.112771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46b35-200e-427a-a789-333d70524c0b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:47.113056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46b35-200e-427a-a789-333d70524c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:47.113332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46b35-200e-427a-a789-333d70524c0b None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:47.114065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f46b35-200e-427a-a789-333d70524c0b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:47.114399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f46b35-200e-427a-a789-333d70524c0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:47.115856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f46b35-200e-427a-a789-333d70524c0b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:47.139348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 337/659] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Aug 31 00:55:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:47.140034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f46b35-200e-427a-a789-333d70524c0b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:47.229584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a265c11-2503-4f79-b385-afec2c1f0f78 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:47.260514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f46b35-200e-427a-a789-333d70524c0b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:47.262729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:47.270904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615e541-fb04-46e1-8514-79d47378f776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:47.271952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e541-fb04-46e1-8514-79d47378f776 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:47.272457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e541-fb04-46e1-8514-79d47378f776 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:47.272997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e541-fb04-46e1-8514-79d47378f776 None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/814473b735314e4cb2321e952777031c/roles/7953b234543143eab052272480b952ec` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:47.287631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:47.297146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615e541-fb04-46e1-8514-79d47378f776 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=814473b735314e4cb2321e952777031c, role_id=7953b234543143eab052272480b952ec)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:47.298627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615e541-fb04-46e1-8514-79d47378f776 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:47.301009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978cdaf-fd91-4b44-a24a-af673990baf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:47.301537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978cdaf-fd91-4b44-a24a-af673990baf9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:47.301818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978cdaf-fd91-4b44-a24a-af673990baf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:47.302437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978cdaf-fd91-4b44-a24a-af673990baf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:47.302794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978cdaf-fd91-4b44-a24a-af673990baf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:47.303204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978cdaf-fd91-4b44-a24a-af673990baf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:47.305834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978cdaf-fd91-4b44-a24a-af673990baf9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:47.314643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 323/660] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:55:47 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/814473b735314e4cb2321e952777031c/roles/7953b234543143eab052272480b952ec => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:55:47.315972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615e541-fb04-46e1-8514-79d47378f776 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:47.334660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 338/661] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:47.336648 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978cdaf-fd91-4b44-a24a-af673990baf9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:47.459230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615e541-fb04-46e1-8514-79d47378f776 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:47.485758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978cdaf-fd91-4b44-a24a-af673990baf9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:47.504615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad90a1-4450-4ee2-9d4d-4e6f346d1185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:47.505553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad90a1-4450-4ee2-9d4d-4e6f346d1185 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:47.506019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad90a1-4450-4ee2-9d4d-4e6f346d1185 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:47.506482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad90a1-4450-4ee2-9d4d-4e6f346d1185 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:47.514516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad90a1-4450-4ee2-9d4d-4e6f346d1185 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:47.516033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad90a1-4450-4ee2-9d4d-4e6f346d1185 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:47.528907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb33b1c-3691-4ba5-abe3-8d3132c35dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:47.529521 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb33b1c-3691-4ba5-abe3-8d3132c35dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:47.529807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb33b1c-3691-4ba5-abe3-8d3132c35dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:47.530085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb33b1c-3691-4ba5-abe3-8d3132c35dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-15ad90a1-4450-4ee2-9d4d-4e6f346d1185 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:47.531049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:47.532026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:47.533045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:47.533045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:47.533045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:47.533045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:47.533045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:47.533045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:47.533045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:47.533045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:47.533045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:55:47.533045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:47.534929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 324/662] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:47.535944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad90a1-4450-4ee2-9d4d-4e6f346d1185 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:47.581124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:47.594878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:47.618672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb33b1c-3691-4ba5-abe3-8d3132c35dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:47.620814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb33b1c-3691-4ba5-abe3-8d3132c35dd8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:47.652497 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad90a1-4450-4ee2-9d4d-4e6f346d1185 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:47.691298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6c94b-1d88-44fa-bdd1-68956c14043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:47.692238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6c94b-1d88-44fa-bdd1-68956c14043a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:47.692760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6c94b-1d88-44fa-bdd1-68956c14043a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:47.693355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6c94b-1d88-44fa-bdd1-68956c14043a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:47.695551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6c94b-1d88-44fa-bdd1-68956c14043a None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=a99d74d9d72c4fc2a363ce6559e4ddff) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:47.696304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6c94b-1d88-44fa-bdd1-68956c14043a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:47.698172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6c94b-1d88-44fa-bdd1-68956c14043a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:47.704869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 325/663] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:47 2022] GET /identity/v3/role_assignments?user.id=a99d74d9d72c4fc2a363ce6559e4ddff&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:47.705943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6c94b-1d88-44fa-bdd1-68956c14043a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:47.786625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 339/664] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:47.792920 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb33b1c-3691-4ba5-abe3-8d3132c35dd8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:47.907291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6c94b-1d88-44fa-bdd1-68956c14043a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:47.912470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:47.947840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:47.956024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac670b0b-c204-4722-8ae9-c44f5b059094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:47.956681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac670b0b-c204-4722-8ae9-c44f5b059094 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:47.956969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac670b0b-c204-4722-8ae9-c44f5b059094 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:47.957247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac670b0b-c204-4722-8ae9-c44f5b059094 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:47.958266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac670b0b-c204-4722-8ae9-c44f5b059094 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:47.958266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac670b0b-c204-4722-8ae9-c44f5b059094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:47.959856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac670b0b-c204-4722-8ae9-c44f5b059094 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:47.971408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb33b1c-3691-4ba5-abe3-8d3132c35dd8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:47.980883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 326/665] 10.222.0.83 () {56 vars in 1139 bytes} [Wed Aug 31 00:55:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:47.986551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac670b0b-c204-4722-8ae9-c44f5b059094 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:48.012279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d46948-ad01-43a3-86b7-7522efd8b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:48.013502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d46948-ad01-43a3-86b7-7522efd8b6ad None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:48.013942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d46948-ad01-43a3-86b7-7522efd8b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:48.014499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d46948-ad01-43a3-86b7-7522efd8b6ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:48.028792 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d46948-ad01-43a3-86b7-7522efd8b6ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:48.030851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d46948-ad01-43a3-86b7-7522efd8b6ad None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c7d46948-ad01-43a3-86b7-7522efd8b6ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:48.049018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:48.050416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:48.051304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:48.051304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:48.051304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:48.053557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 340/666] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:48.059517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d46948-ad01-43a3-86b7-7522efd8b6ad None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:48.109163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac670b0b-c204-4722-8ae9-c44f5b059094 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:48.155715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87d39f-ad2e-4d0e-8281-9b064834ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:48.156641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87d39f-ad2e-4d0e-8281-9b064834ff04 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:48.156928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87d39f-ad2e-4d0e-8281-9b064834ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:48.157205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87d39f-ad2e-4d0e-8281-9b064834ff04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:48.177869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d46948-ad01-43a3-86b7-7522efd8b6ad None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:48.203674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:48.228137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2750c-e401-4d86-b5ad-ac4470f17580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:48.229228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2750c-e401-4d86-b5ad-ac4470f17580 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:48.229845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2750c-e401-4d86-b5ad-ac4470f17580 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:48.230478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2750c-e401-4d86-b5ad-ac4470f17580 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:48.231404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2750c-e401-4d86-b5ad-ac4470f17580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:48.231938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2750c-e401-4d86-b5ad-ac4470f17580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:48.233809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2750c-e401-4d86-b5ad-ac4470f17580 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:48.238647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:48.254860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 341/667] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:48.264561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87d39f-ad2e-4d0e-8281-9b064834ff04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:48.265887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2750c-e401-4d86-b5ad-ac4470f17580 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:48.266071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87d39f-ad2e-4d0e-8281-9b064834ff04 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:48.415901 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2750c-e401-4d86-b5ad-ac4470f17580 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:48.433089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 327/668] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:48.441635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87d39f-ad2e-4d0e-8281-9b064834ff04 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:48.452984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dced3-d4d4-4664-ab36-fc731079f905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:48.453681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dced3-d4d4-4664-ab36-fc731079f905 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:48.453964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dced3-d4d4-4664-ab36-fc731079f905 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:48.454272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dced3-d4d4-4664-ab36-fc731079f905 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:48.462251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dced3-d4d4-4664-ab36-fc731079f905 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:48.468347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dced3-d4d4-4664-ab36-fc731079f905 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-aa7dced3-d4d4-4664-ab36-fc731079f905 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:48.476668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:48.477716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:48.479078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:48.479078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:48.479078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:48.479078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:48.479078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:48.479078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:48.479078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:48.479078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:48.479078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 342/669] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:48.486271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dced3-d4d4-4664-ab36-fc731079f905 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:48.547057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:48.568377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:48.597477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dced3-d4d4-4664-ab36-fc731079f905 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:48.635211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea895d-75ed-42f8-9da7-ba616104db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:48.636156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea895d-75ed-42f8-9da7-ba616104db9b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:48.636466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea895d-75ed-42f8-9da7-ba616104db9b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:48.636778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea895d-75ed-42f8-9da7-ba616104db9b None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:48.637479 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea895d-75ed-42f8-9da7-ba616104db9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:48.637784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea895d-75ed-42f8-9da7-ba616104db9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:48.639228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea895d-75ed-42f8-9da7-ba616104db9b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:48.652821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 343/670] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:48.657056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87d39f-ad2e-4d0e-8281-9b064834ff04 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:48.658607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea895d-75ed-42f8-9da7-ba616104db9b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:48.745796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc147-f5b0-4814-b250-cd807dece758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:48.746498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc147-f5b0-4814-b250-cd807dece758 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:48.746841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc147-f5b0-4814-b250-cd807dece758 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:48.747225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc147-f5b0-4814-b250-cd807dece758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:48.767398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea895d-75ed-42f8-9da7-ba616104db9b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:48.770118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc147-f5b0-4814-b250-cd807dece758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:48.771602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc147-f5b0-4814-b250-cd807dece758 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:48.785647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-f71cc147-f5b0-4814-b250-cd807dece758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:48.806096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:48.807111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:48.808305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:48.808305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:48.808305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:48.808505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb390ec2-f772-481b-b73d-17cde19ee84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:48.808505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390ec2-f772-481b-b73d-17cde19ee84b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:48.808505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390ec2-f772-481b-b73d-17cde19ee84b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:48.808727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 328/671] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:48.808796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390ec2-f772-481b-b73d-17cde19ee84b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:48.808796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb390ec2-f772-481b-b73d-17cde19ee84b None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=376dd413b33c4f4987f6bba3b14f3bd1) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:48.808925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb390ec2-f772-481b-b73d-17cde19ee84b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:48.813538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb390ec2-f772-481b-b73d-17cde19ee84b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:48.815122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc147-f5b0-4814-b250-cd807dece758 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:48.817421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 344/672] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:48 2022] GET /identity/v3/role_assignments?user.id=376dd413b33c4f4987f6bba3b14f3bd1&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:48.930179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79842f5-28d5-4b53-9b92-63b04da71ec8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:48.930533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79842f5-28d5-4b53-9b92-63b04da71ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:48.930888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79842f5-28d5-4b53-9b92-63b04da71ec8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:48.936610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 345/673] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:55:48.946640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472ed31-02fe-4c3e-9254-123814b208f8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:48.946957 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472ed31-02fe-4c3e-9254-123814b208f8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:48.947200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472ed31-02fe-4c3e-9254-123814b208f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:48.984005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f472ed31-02fe-4c3e-9254-123814b208f8 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:48.987423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc147-f5b0-4814-b250-cd807dece758 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:48.993018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f472ed31-02fe-4c3e-9254-123814b208f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:49.020909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:49.030272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad2aa0-7cb5-4e69-bdfb-cef27ccdc660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:49.031334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad2aa0-7cb5-4e69-bdfb-cef27ccdc660 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:49.031781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad2aa0-7cb5-4e69-bdfb-cef27ccdc660 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:49.032233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad2aa0-7cb5-4e69-bdfb-cef27ccdc660 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:49.033021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad2aa0-7cb5-4e69-bdfb-cef27ccdc660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:49.033330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad2aa0-7cb5-4e69-bdfb-cef27ccdc660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:49.034714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad2aa0-7cb5-4e69-bdfb-cef27ccdc660 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:49.051524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 329/674] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:49.058393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad2aa0-7cb5-4e69-bdfb-cef27ccdc660 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:49.077237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 346/675] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:49.193176 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad2aa0-7cb5-4e69-bdfb-cef27ccdc660 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:49.230478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd1a85-3309-47db-acd6-d4402e1a1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:49.231126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd1a85-3309-47db-acd6-d4402e1a1c7a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:49.231411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd1a85-3309-47db-acd6-d4402e1a1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:49.231688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd1a85-3309-47db-acd6-d4402e1a1c7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:49.239133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd1a85-3309-47db-acd6-d4402e1a1c7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:49.240612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd1a85-3309-47db-acd6-d4402e1a1c7a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-14fd1a85-3309-47db-acd6-d4402e1a1c7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:49.253609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:49.255727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:49.258115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:49.258115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:49.258115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:49.258115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:49.258115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:49.258115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:49.258115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:49.258115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:49.258115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 330/676] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:49.261681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472ed31-02fe-4c3e-9254-123814b208f8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:49.388777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472ed31-02fe-4c3e-9254-123814b208f8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:49.402005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:49.434908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84d129-3b9b-4517-a1b2-ff5b3955928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:49.435530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84d129-3b9b-4517-a1b2-ff5b3955928f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:49.435812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84d129-3b9b-4517-a1b2-ff5b3955928f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:49.436089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84d129-3b9b-4517-a1b2-ff5b3955928f None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:49.436874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84d129-3b9b-4517-a1b2-ff5b3955928f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:49.437186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84d129-3b9b-4517-a1b2-ff5b3955928f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:49.438625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84d129-3b9b-4517-a1b2-ff5b3955928f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:49.458195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 347/677] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:49.465069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd1a85-3309-47db-acd6-d4402e1a1c7a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:49.514202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:49.532702 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f6fc7-2618-41c8-92c8-c9f8ee160066 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:49.533017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f6fc7-2618-41c8-92c8-c9f8ee160066 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:49.533253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f6fc7-2618-41c8-92c8-c9f8ee160066 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:49.534585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 348/678] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:49.547611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f82a2d-a1ba-489e-b555-45dece94bdbc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:49.547960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f82a2d-a1ba-489e-b555-45dece94bdbc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:49.548480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f82a2d-a1ba-489e-b555-45dece94bdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:49.577296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-63f82a2d-a1ba-489e-b555-45dece94bdbc None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:49.578705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-63f82a2d-a1ba-489e-b555-45dece94bdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:49.605256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd1a85-3309-47db-acd6-d4402e1a1c7a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:49.651412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd842a0-45b9-4cd9-8bee-f95eb0c0a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:49.651959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd842a0-45b9-4cd9-8bee-f95eb0c0a0bd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:49.652247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd842a0-45b9-4cd9-8bee-f95eb0c0a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:49.652557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd842a0-45b9-4cd9-8bee-f95eb0c0a0bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:49.653317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd842a0-45b9-4cd9-8bee-f95eb0c0a0bd None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=f6c13711596647178ad3f93865eca187) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:49.653635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd842a0-45b9-4cd9-8bee-f95eb0c0a0bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:49.655154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd842a0-45b9-4cd9-8bee-f95eb0c0a0bd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:49.662464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 331/679] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:49 2022] GET /identity/v3/role_assignments?user.id=f6c13711596647178ad3f93865eca187&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:49.663388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd842a0-45b9-4cd9-8bee-f95eb0c0a0bd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:49.678191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 349/680] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:49.790031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:49.794846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd842a0-45b9-4cd9-8bee-f95eb0c0a0bd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:49.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa31244-68df-497f-8853-1f1261954cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:49.836018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa31244-68df-497f-8853-1f1261954cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:49.836517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa31244-68df-497f-8853-1f1261954cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:49.836978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa31244-68df-497f-8853-1f1261954cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:49.851925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa31244-68df-497f-8853-1f1261954cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:49.853748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa31244-68df-497f-8853-1f1261954cc3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-caa31244-68df-497f-8853-1f1261954cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:49.871307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:49.872361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:49.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:49.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:49.873294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:49.875098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 332/681] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:49.881161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f82a2d-a1ba-489e-b555-45dece94bdbc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:49.990408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:49.993742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f82a2d-a1ba-489e-b555-45dece94bdbc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:50.032062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c59d0-88ad-4c30-a332-39201aa3fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:50.033003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c59d0-88ad-4c30-a332-39201aa3fc22 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:50.033432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c59d0-88ad-4c30-a332-39201aa3fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:50.033876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c59d0-88ad-4c30-a332-39201aa3fc22 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:50.034687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c59d0-88ad-4c30-a332-39201aa3fc22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:50.035138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c59d0-88ad-4c30-a332-39201aa3fc22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:50.036685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c59d0-88ad-4c30-a332-39201aa3fc22 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:50.050042 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 350/682] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:50.056142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa31244-68df-497f-8853-1f1261954cc3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:50.074853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c59d0-88ad-4c30-a332-39201aa3fc22 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:50.213471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa31244-68df-497f-8853-1f1261954cc3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:50.238754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c59d0-88ad-4c30-a332-39201aa3fc22 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:50.295142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3f9e1-3199-47bc-b9ac-e3d1ae4d40a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:50.295777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3f9e1-3199-47bc-b9ac-e3d1ae4d40a8 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:50.296165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3f9e1-3199-47bc-b9ac-e3d1ae4d40a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:50.296478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3f9e1-3199-47bc-b9ac-e3d1ae4d40a8 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:50.297356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3f9e1-3199-47bc-b9ac-e3d1ae4d40a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:50.299044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58171a8-c5fb-4e27-b5cb-64b48aed9ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:50.300069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58171a8-c5fb-4e27-b5cb-64b48aed9ffe None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:50.300604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58171a8-c5fb-4e27-b5cb-64b48aed9ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:50.301101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58171a8-c5fb-4e27-b5cb-64b48aed9ffe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:50.305369 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3f9e1-3199-47bc-b9ac-e3d1ae4d40a8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:50.327803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58171a8-c5fb-4e27-b5cb-64b48aed9ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d58171a8-c5fb-4e27-b5cb-64b48aed9ffe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:50.333134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:50.334851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:50.337848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 351/683] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:50.343410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58171a8-c5fb-4e27-b5cb-64b48aed9ffe None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:50.360231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 333/684] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:55:50 2022] POST /identity/v3/users => generated 254 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:55:50.393001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:50.474311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58171a8-c5fb-4e27-b5cb-64b48aed9ffe None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:50.512086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bf94f-5a7e-4972-922d-4a3c9d3e94fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:50.512764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf94f-5a7e-4972-922d-4a3c9d3e94fb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:50.513490 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf94f-5a7e-4972-922d-4a3c9d3e94fb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:50.513775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf94f-5a7e-4972-922d-4a3c9d3e94fb None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:50.514474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bf94f-5a7e-4972-922d-4a3c9d3e94fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:50.514783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bf94f-5a7e-4972-922d-4a3c9d3e94fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:50.516197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bf94f-5a7e-4972-922d-4a3c9d3e94fb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:50.526470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 352/685] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:50.532606 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3f9e1-3199-47bc-b9ac-e3d1ae4d40a8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:50.544738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:50.661896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3f9e1-3199-47bc-b9ac-e3d1ae4d40a8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:50.666397 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2234811-eaf6-42a2-b0ba-6db6ada6580e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:50.666709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2234811-eaf6-42a2-b0ba-6db6ada6580e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:50.666990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2234811-eaf6-42a2-b0ba-6db6ada6580e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:50.671059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 353/686] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:55:50.674375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c172c-2a15-4e67-a7f7-2c740bd19940 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:50.674672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c172c-2a15-4e67-a7f7-2c740bd19940 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:50.674950 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c172c-2a15-4e67-a7f7-2c740bd19940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:50.698022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-104c172c-2a15-4e67-a7f7-2c740bd19940 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:50.699220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-104c172c-2a15-4e67-a7f7-2c740bd19940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:50.705982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22403438-fc5f-4368-b2a5-155c8dbfd5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:50.706644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403438-fc5f-4368-b2a5-155c8dbfd5ab None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:50.706933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403438-fc5f-4368-b2a5-155c8dbfd5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:50.707221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403438-fc5f-4368-b2a5-155c8dbfd5ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:50.722707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22403438-fc5f-4368-b2a5-155c8dbfd5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:50.724180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22403438-fc5f-4368-b2a5-155c8dbfd5ab None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-22403438-fc5f-4368-b2a5-155c8dbfd5ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:50.743874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:50.744930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:50.747177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:50.747177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:50.747177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:50.747177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 334/687] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:50.751954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22403438-fc5f-4368-b2a5-155c8dbfd5ab None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:50.809973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 354/688] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:55:50.833704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:50.877692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22403438-fc5f-4368-b2a5-155c8dbfd5ab None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:50.912984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a376a9-dc86-4333-b913-4e84889d3fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:50.914095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a376a9-dc86-4333-b913-4e84889d3fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:50.914382 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a376a9-dc86-4333-b913-4e84889d3fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:50.914659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a376a9-dc86-4333-b913-4e84889d3fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:50.915313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a376a9-dc86-4333-b913-4e84889d3fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:50.915649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a376a9-dc86-4333-b913-4e84889d3fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:50.917028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a376a9-dc86-4333-b913-4e84889d3fd6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:50.929912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 335/689] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:50.935486 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c172c-2a15-4e67-a7f7-2c740bd19940 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:50.971860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:51.101634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c172c-2a15-4e67-a7f7-2c740bd19940 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:51.105595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a376a9-dc86-4333-b913-4e84889d3fd6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:51.158017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a125b-57d1-425c-9c5f-446d010a928d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:51.158665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a125b-57d1-425c-9c5f-446d010a928d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:51.158942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a125b-57d1-425c-9c5f-446d010a928d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:51.159214 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a125b-57d1-425c-9c5f-446d010a928d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:51.175853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a125b-57d1-425c-9c5f-446d010a928d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:51.177989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a125b-57d1-425c-9c5f-446d010a928d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-710a125b-57d1-425c-9c5f-446d010a928d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:51.197138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:51.198169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:51.199119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 355/690] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:55:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:51.207970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a125b-57d1-425c-9c5f-446d010a928d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:51.289248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a376a9-dc86-4333-b913-4e84889d3fd6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:51.309669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:51.343519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe9c4e-1ced-4149-85ff-1f7ef5a78d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:51.346244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe9c4e-1ced-4149-85ff-1f7ef5a78d0b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:51.348124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe9c4e-1ced-4149-85ff-1f7ef5a78d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:51.349220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe9c4e-1ced-4149-85ff-1f7ef5a78d0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:51.373595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe9c4e-1ced-4149-85ff-1f7ef5a78d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:51.376696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9ffe9c4e-1ced-4149-85ff-1f7ef5a78d0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:51.384233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:51.386044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:51.387683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:51.392205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 336/691] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:55:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:51.401153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe9c4e-1ced-4149-85ff-1f7ef5a78d0b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:51.421863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a125b-57d1-425c-9c5f-446d010a928d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:51.490300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687f15-d7ed-483c-96c5-02f3acf1b4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:51.490885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687f15-d7ed-483c-96c5-02f3acf1b4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:51.491173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687f15-d7ed-483c-96c5-02f3acf1b4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:51.491526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687f15-d7ed-483c-96c5-02f3acf1b4a1 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:51.493093 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3687f15-d7ed-483c-96c5-02f3acf1b4a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:51.493284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3687f15-d7ed-483c-96c5-02f3acf1b4a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:51.494805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3687f15-d7ed-483c-96c5-02f3acf1b4a1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:51.529973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 356/692] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Aug 31 00:55:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:51.539823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687f15-d7ed-483c-96c5-02f3acf1b4a1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:51.590879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe9c4e-1ced-4149-85ff-1f7ef5a78d0b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:51.629723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5024e4-18b6-483b-8335-850352d3a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:51.630388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5024e4-18b6-483b-8335-850352d3a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:51.630906 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5024e4-18b6-483b-8335-850352d3a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:51.631017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5024e4-18b6-483b-8335-850352d3a4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:51.631642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5024e4-18b6-483b-8335-850352d3a4b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:51.631947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5024e4-18b6-483b-8335-850352d3a4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:51.633998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5024e4-18b6-483b-8335-850352d3a4b1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:51.643510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 337/693] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:51.645259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74f609-e3a9-4c72-97b4-eb307ae16ece None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:51.645671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74f609-e3a9-4c72-97b4-eb307ae16ece None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:51.645940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74f609-e3a9-4c72-97b4-eb307ae16ece None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:51.652198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 338/694] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:51.653135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74f609-e3a9-4c72-97b4-eb307ae16ece None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:51.693216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687f15-d7ed-483c-96c5-02f3acf1b4a1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:51.703105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:51.727744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:51.735308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1af33d-23b1-49ee-92c1-86cfca65db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:51.736223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af33d-23b1-49ee-92c1-86cfca65db39 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:51.736742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af33d-23b1-49ee-92c1-86cfca65db39 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:51.737246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af33d-23b1-49ee-92c1-86cfca65db39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:51.772401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74f609-e3a9-4c72-97b4-eb307ae16ece None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:51.809867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a672fbb-4065-4b0b-b448-bb11cabf7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:51.810508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a672fbb-4065-4b0b-b448-bb11cabf7b96 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:51.810788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a672fbb-4065-4b0b-b448-bb11cabf7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:51.811110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a672fbb-4065-4b0b-b448-bb11cabf7b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:51.815223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1af33d-23b1-49ee-92c1-86cfca65db39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:51.816975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1af33d-23b1-49ee-92c1-86cfca65db39 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:51.822405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a672fbb-4065-4b0b-b448-bb11cabf7b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:51.823907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a672fbb-4065-4b0b-b448-bb11cabf7b96 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7a672fbb-4065-4b0b-b448-bb11cabf7b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:51.839914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:51.841085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:51.842434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:51.842434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:51.842434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:51.842434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 339/695] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:51.843837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be112ee0-dfc0-4427-bc59-d57ecdccc7ce None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:51.844121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be112ee0-dfc0-4427-bc59-d57ecdccc7ce None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:51.844428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be112ee0-dfc0-4427-bc59-d57ecdccc7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:51.862935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-be112ee0-dfc0-4427-bc59-d57ecdccc7ce None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:51.864116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-be112ee0-dfc0-4427-bc59-d57ecdccc7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:51.939931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 357/696] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:55:51.940903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1af33d-23b1-49ee-92c1-86cfca65db39 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:51.948595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 340/697] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:51.949571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be112ee0-dfc0-4427-bc59-d57ecdccc7ce None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:51.977191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:51.986016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:52.056453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1af33d-23b1-49ee-92c1-86cfca65db39 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:52.088383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6feaac-a65f-4dcf-8695-d12a6183366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:52.088383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6feaac-a65f-4dcf-8695-d12a6183366b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.088383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6feaac-a65f-4dcf-8695-d12a6183366b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.088383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6feaac-a65f-4dcf-8695-d12a6183366b None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.088799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6feaac-a65f-4dcf-8695-d12a6183366b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:52.088799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6feaac-a65f-4dcf-8695-d12a6183366b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:52.089818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6feaac-a65f-4dcf-8695-d12a6183366b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:52.107294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 358/698] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:52.108549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6feaac-a65f-4dcf-8695-d12a6183366b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:52.117212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be112ee0-dfc0-4427-bc59-d57ecdccc7ce None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:52.178144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041914e-d635-45cc-a25b-30e5cd7579fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:52.178793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041914e-d635-45cc-a25b-30e5cd7579fa None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.179349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041914e-d635-45cc-a25b-30e5cd7579fa None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.179628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041914e-d635-45cc-a25b-30e5cd7579fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.201388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041914e-d635-45cc-a25b-30e5cd7579fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:52.202852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041914e-d635-45cc-a25b-30e5cd7579fa None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:52.206026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:52.217641 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6feaac-a65f-4dcf-8695-d12a6183366b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2041914e-d635-45cc-a25b-30e5cd7579fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:52.230853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:52.231837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:52.232772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:52.232772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:52.232772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:52.232772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 341/699] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:52.237672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041914e-d635-45cc-a25b-30e5cd7579fa None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:52.283495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e783282-cd1b-4fdb-84cf-9e0153f3f776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:52.284563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e783282-cd1b-4fdb-84cf-9e0153f3f776 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.285054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e783282-cd1b-4fdb-84cf-9e0153f3f776 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.285528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e783282-cd1b-4fdb-84cf-9e0153f3f776 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.300232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e783282-cd1b-4fdb-84cf-9e0153f3f776 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:52.302032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e783282-cd1b-4fdb-84cf-9e0153f3f776 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-7e783282-cd1b-4fdb-84cf-9e0153f3f776 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:52.328715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:52.329706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:52.330646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:52.330646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:52.330646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:52.330646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:52.330646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:52.330646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:52.330646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:52.330646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:52.330646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:55:52.330646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:52.333270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 359/700] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Aug 31 00:55:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:52.336466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:52.338855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e783282-cd1b-4fdb-84cf-9e0153f3f776 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:52.364928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041914e-d635-45cc-a25b-30e5cd7579fa None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:52.419768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c540d-d279-400d-9634-da151fdf7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:52.420457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c540d-d279-400d-9634-da151fdf7e05 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.420738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c540d-d279-400d-9634-da151fdf7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.421008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c540d-d279-400d-9634-da151fdf7e05 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.421663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c540d-d279-400d-9634-da151fdf7e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:52.421965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c540d-d279-400d-9634-da151fdf7e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:52.423327 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c540d-d279-400d-9634-da151fdf7e05 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:52.445212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 342/701] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:52.446469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c540d-d279-400d-9634-da151fdf7e05 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:52.505488 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e783282-cd1b-4fdb-84cf-9e0153f3f776 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:52.549820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83841-8932-4fbc-9fc8-c590b7939b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:52.550428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83841-8932-4fbc-9fc8-c590b7939b6f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.550705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83841-8932-4fbc-9fc8-c590b7939b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.550978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83841-8932-4fbc-9fc8-c590b7939b6f None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.551706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e83841-8932-4fbc-9fc8-c590b7939b6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:52.552011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e83841-8932-4fbc-9fc8-c590b7939b6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:52.553469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e83841-8932-4fbc-9fc8-c590b7939b6f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:52.573557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 360/702] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Aug 31 00:55:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:52.574551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83841-8932-4fbc-9fc8-c590b7939b6f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:52.575354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c540d-d279-400d-9634-da151fdf7e05 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:52.588279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:52.618036 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d21394-d917-47dd-b0dd-de2bbf0559ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:52.618698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d21394-d917-47dd-b0dd-de2bbf0559ec None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.618978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d21394-d917-47dd-b0dd-de2bbf0559ec None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.619249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d21394-d917-47dd-b0dd-de2bbf0559ec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.619935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d21394-d917-47dd-b0dd-de2bbf0559ec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:52.621534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d21394-d917-47dd-b0dd-de2bbf0559ec None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:52.623803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-05d21394-d917-47dd-b0dd-de2bbf0559ec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:52.636194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:52.637329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:52.638247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 343/703] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Aug 31 00:55:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:52.639050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d21394-d917-47dd-b0dd-de2bbf0559ec None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:52.706171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83841-8932-4fbc-9fc8-c590b7939b6f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:52.743972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f349bb-0d0e-446a-9c94-29cfb029fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:52.744656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f349bb-0d0e-446a-9c94-29cfb029fd75 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.744940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f349bb-0d0e-446a-9c94-29cfb029fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.745225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f349bb-0d0e-446a-9c94-29cfb029fd75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.752755 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f349bb-0d0e-446a-9c94-29cfb029fd75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:52.754209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f349bb-0d0e-446a-9c94-29cfb029fd75 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:52.754418 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d21394-d917-47dd-b0dd-de2bbf0559ec None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-77f349bb-0d0e-446a-9c94-29cfb029fd75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:52.766990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:52.767938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:52.769237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:52.769237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:52.769237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:52.769237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:52.769237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:52.769237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:52.769237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:52.769237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:52.769237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 361/704] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:52.769237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f349bb-0d0e-446a-9c94-29cfb029fd75 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:52.801058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55394edc-80af-4c5b-b41f-816bdbee3105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:52.801687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394edc-80af-4c5b-b41f-816bdbee3105 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.801973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394edc-80af-4c5b-b41f-816bdbee3105 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.802249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394edc-80af-4c5b-b41f-816bdbee3105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.845685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:52.877104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:52.881512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55394edc-80af-4c5b-b41f-816bdbee3105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:52.883830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55394edc-80af-4c5b-b41f-816bdbee3105 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:52.889640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f349bb-0d0e-446a-9c94-29cfb029fd75 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:52.928123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081ee91-2058-4377-9813-c7cb8eaf86b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:52.928767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081ee91-2058-4377-9813-c7cb8eaf86b2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.929111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081ee91-2058-4377-9813-c7cb8eaf86b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.929893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081ee91-2058-4377-9813-c7cb8eaf86b2 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.930535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081ee91-2058-4377-9813-c7cb8eaf86b2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:52.930844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081ee91-2058-4377-9813-c7cb8eaf86b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:52.932232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081ee91-2058-4377-9813-c7cb8eaf86b2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:52.936787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 362/705] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Aug 31 00:55:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:52.937967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a687-8354-40da-9bd6-8d36c96defed None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.938254 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a687-8354-40da-9bd6-8d36c96defed None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.938574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a687-8354-40da-9bd6-8d36c96defed None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.940017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 363/706] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:52.941495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396a687-8354-40da-9bd6-8d36c96defed None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:52.992669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 344/707] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:52.993997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0920c-8a5b-4d25-9161-074de1eee7c3 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:52.994287 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0920c-8a5b-4d25-9161-074de1eee7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:52.994564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0920c-8a5b-4d25-9161-074de1eee7c3 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:52.996047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 345/708] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:52.998019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0920c-8a5b-4d25-9161-074de1eee7c3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:53.048469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396a687-8354-40da-9bd6-8d36c96defed None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:53.079329 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:53.084976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f7974-7fa9-449f-aaef-51e2cebd6609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:53.086216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f7974-7fa9-449f-aaef-51e2cebd6609 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:53.086497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f7974-7fa9-449f-aaef-51e2cebd6609 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:53.086764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f7974-7fa9-449f-aaef-51e2cebd6609 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:53.087450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f7974-7fa9-449f-aaef-51e2cebd6609 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:53.087753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f7974-7fa9-449f-aaef-51e2cebd6609 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:53.089231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f7974-7fa9-449f-aaef-51e2cebd6609 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:53.100992 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 364/709] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:53.102185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dba81-6497-4826-bc80-94e78380de49 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:53.102473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dba81-6497-4826-bc80-94e78380de49 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:53.102744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dba81-6497-4826-bc80-94e78380de49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:53.120910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-700dba81-6497-4826-bc80-94e78380de49 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:53.122097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-700dba81-6497-4826-bc80-94e78380de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:53.140884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:53.146089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0920c-8a5b-4d25-9161-074de1eee7c3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:53.182209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6febab-f717-4ca8-8488-6f90ed2fd072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:53.182819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6febab-f717-4ca8-8488-6f90ed2fd072 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:53.183105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6febab-f717-4ca8-8488-6f90ed2fd072 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:53.183386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6febab-f717-4ca8-8488-6f90ed2fd072 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:53.184029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6febab-f717-4ca8-8488-6f90ed2fd072 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:53.184340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6febab-f717-4ca8-8488-6f90ed2fd072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:53.185722 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6febab-f717-4ca8-8488-6f90ed2fd072 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:53.191267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 346/710] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Aug 31 00:55:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:53.192059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6febab-f717-4ca8-8488-6f90ed2fd072 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:53.204738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 365/711] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:53.204738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473c8aa-9dd0-499a-892b-9f5e7d9d0f33 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:53.204738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473c8aa-9dd0-499a-892b-9f5e7d9d0f33 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:53.204738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473c8aa-9dd0-499a-892b-9f5e7d9d0f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:53.239517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6473c8aa-9dd0-499a-892b-9f5e7d9d0f33 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:53.240828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6473c8aa-9dd0-499a-892b-9f5e7d9d0f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:53.322551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 366/712] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:53.323578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473c8aa-9dd0-499a-892b-9f5e7d9d0f33 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:53.358268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6febab-f717-4ca8-8488-6f90ed2fd072 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:53.397131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:53.404706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ec360-a743-4de3-897f-4889b0a96c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:53.405447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec360-a743-4de3-897f-4889b0a96c1c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:53.405740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec360-a743-4de3-897f-4889b0a96c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:53.406016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec360-a743-4de3-897f-4889b0a96c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:53.418500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ec360-a743-4de3-897f-4889b0a96c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:53.419968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ec360-a743-4de3-897f-4889b0a96c1c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d70ec360-a743-4de3-897f-4889b0a96c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:53.436140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:53.437195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:53.439051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:53.439051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:53.439051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:53.439051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 347/713] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:53.444159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ec360-a743-4de3-897f-4889b0a96c1c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:53.453076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473c8aa-9dd0-499a-892b-9f5e7d9d0f33 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:53.484755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:53.496184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d815933-e758-4cdc-bc0d-a8588acc399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:53.496806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d815933-e758-4cdc-bc0d-a8588acc399c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:53.497093 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d815933-e758-4cdc-bc0d-a8588acc399c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:53.497436 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d815933-e758-4cdc-bc0d-a8588acc399c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:53.498650 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d815933-e758-4cdc-bc0d-a8588acc399c None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=814473b735314e4cb2321e952777031c) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:53.498968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d815933-e758-4cdc-bc0d-a8588acc399c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:53.504359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d815933-e758-4cdc-bc0d-a8588acc399c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:53.513561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 367/714] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:53 2022] GET /identity/v3/role_assignments?user.id=814473b735314e4cb2321e952777031c&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:53.515062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d815933-e758-4cdc-bc0d-a8588acc399c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:53.650695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d815933-e758-4cdc-bc0d-a8588acc399c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:53.659322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ec360-a743-4de3-897f-4889b0a96c1c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:53.670939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:53.692186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5398-368f-4325-bdf0-a4bc708a540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:53.693005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5398-368f-4325-bdf0-a4bc708a540a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:53.693294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5398-368f-4325-bdf0-a4bc708a540a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:53.693577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5398-368f-4325-bdf0-a4bc708a540a None admin] PATH_INFO: `/v3/services/network` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:53.694306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd5398-368f-4325-bdf0-a4bc708a540a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:53.696662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd5398-368f-4325-bdf0-a4bc708a540a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:53.703813 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426ad1-39e2-43ae-9cff-3849ef450ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:53.704800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426ad1-39e2-43ae-9cff-3849ef450ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:53.705295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426ad1-39e2-43ae-9cff-3849ef450ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:53.705872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426ad1-39e2-43ae-9cff-3849ef450ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:53.706820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d426ad1-39e2-43ae-9cff-3849ef450ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:53.707340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d426ad1-39e2-43ae-9cff-3849ef450ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3bfd5398-368f-4325-bdf0-a4bc708a540a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:53.708827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:53.709812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:53.711906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 368/715] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:53 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:53.712731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5398-368f-4325-bdf0-a4bc708a540a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:53.712809 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d426ad1-39e2-43ae-9cff-3849ef450ca5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:53.736150 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 348/716] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:53.736933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426ad1-39e2-43ae-9cff-3849ef450ca5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:53.840464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:53.868655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426ad1-39e2-43ae-9cff-3849ef450ca5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:53.872986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5398-368f-4325-bdf0-a4bc708a540a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:53.911172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883e195-ecfa-4cfa-b934-1c49145148b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:53.911764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883e195-ecfa-4cfa-b934-1c49145148b6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:53.912057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883e195-ecfa-4cfa-b934-1c49145148b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:53.912355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883e195-ecfa-4cfa-b934-1c49145148b6 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:53.913205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883e195-ecfa-4cfa-b934-1c49145148b6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:53.914122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883e195-ecfa-4cfa-b934-1c49145148b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:53.915300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883e195-ecfa-4cfa-b934-1c49145148b6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:53.924364 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 349/717] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:55:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:53.924364 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883e195-ecfa-4cfa-b934-1c49145148b6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:53.927798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6669f3b-863b-4486-a013-15de54fe75b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:53.928678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6669f3b-863b-4486-a013-15de54fe75b4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:53.929309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6669f3b-863b-4486-a013-15de54fe75b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:53.929955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6669f3b-863b-4486-a013-15de54fe75b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:53.942678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6669f3b-863b-4486-a013-15de54fe75b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d6669f3b-863b-4486-a013-15de54fe75b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:53.948987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:53.950205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:55:53.951142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:53.953466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 369/718] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:55:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:53.954590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6669f3b-863b-4486-a013-15de54fe75b4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:54.004686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:54.068565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883e195-ecfa-4cfa-b934-1c49145148b6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:54.071801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6669f3b-863b-4486-a013-15de54fe75b4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:54.113042 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2cef6-9739-4ac9-ad08-a15b5aacb125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:54.114487 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2cef6-9739-4ac9-ad08-a15b5aacb125 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:54.114985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2cef6-9739-4ac9-ad08-a15b5aacb125 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:54.115467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2cef6-9739-4ac9-ad08-a15b5aacb125 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:54.116380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2cef6-9739-4ac9-ad08-a15b5aacb125 None admin] RBAC: Adding query filter params (type=network) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:54.117634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2cef6-9739-4ac9-ad08-a15b5aacb125 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:54.118578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86cd45-1546-4ef6-b65a-f36e0c5eb306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:54.119223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86cd45-1546-4ef6-b65a-f36e0c5eb306 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:54.119508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86cd45-1546-4ef6-b65a-f36e0c5eb306 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:54.119787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86cd45-1546-4ef6-b65a-f36e0c5eb306 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:54.120179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2cef6-9739-4ac9-ad08-a15b5aacb125 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:54.127350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 370/719] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:55:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:54.128728 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2cef6-9739-4ac9-ad08-a15b5aacb125 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:54.137960 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86cd45-1546-4ef6-b65a-f36e0c5eb306 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:54.140037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86cd45-1546-4ef6-b65a-f36e0c5eb306 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:54.149079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ad86cd45-1546-4ef6-b65a-f36e0c5eb306 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:54.169416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:54.170338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:54.171234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:54.171234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:54.171234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:54.171234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:54.171234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:54.171234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:54.171234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:54.171234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:54.171234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 350/720] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:54.178206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86cd45-1546-4ef6-b65a-f36e0c5eb306 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:54.327969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2cef6-9739-4ac9-ad08-a15b5aacb125 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:54.332804 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86cd45-1546-4ef6-b65a-f36e0c5eb306 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:54.342742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:54.373365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936fadd-d6be-46c5-b74f-eafaf2d460c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:54.373985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936fadd-d6be-46c5-b74f-eafaf2d460c9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:54.374300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936fadd-d6be-46c5-b74f-eafaf2d460c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:54.374537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936fadd-d6be-46c5-b74f-eafaf2d460c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:54.375238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936fadd-d6be-46c5-b74f-eafaf2d460c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:54.375512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936fadd-d6be-46c5-b74f-eafaf2d460c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:54.376976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f1aad-fb26-42ff-a925-00e99a1dc62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:54.377106 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936fadd-d6be-46c5-b74f-eafaf2d460c9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:54.377603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1aad-fb26-42ff-a925-00e99a1dc62e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:54.377893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1aad-fb26-42ff-a925-00e99a1dc62e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:54.378179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1aad-fb26-42ff-a925-00e99a1dc62e None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:54.378888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f1aad-fb26-42ff-a925-00e99a1dc62e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:54.379202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f1aad-fb26-42ff-a925-00e99a1dc62e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:54.380681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f1aad-fb26-42ff-a925-00e99a1dc62e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:54.387604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 371/721] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:55:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:54.398869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936fadd-d6be-46c5-b74f-eafaf2d460c9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:54.401018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 351/722] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:54.409705 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f1aad-fb26-42ff-a925-00e99a1dc62e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:54.494480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:54.546196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f1aad-fb26-42ff-a925-00e99a1dc62e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:54.586195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caada97-c48d-4c78-ad5f-1254f98962b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:54.586671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caada97-c48d-4c78-ad5f-1254f98962b8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:54.586671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caada97-c48d-4c78-ad5f-1254f98962b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:54.587084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caada97-c48d-4c78-ad5f-1254f98962b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:54.588146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caada97-c48d-4c78-ad5f-1254f98962b8 None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=a99d74d9d72c4fc2a363ce6559e4ddff) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:54.588607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caada97-c48d-4c78-ad5f-1254f98962b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:54.592423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caada97-c48d-4c78-ad5f-1254f98962b8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:54.596883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 352/723] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:54 2022] GET /identity/v3/role_assignments?user.id=a99d74d9d72c4fc2a363ce6559e4ddff&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:54.621857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936fadd-d6be-46c5-b74f-eafaf2d460c9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:54.686054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb6a9-948f-4947-853e-e5c625c55cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:54.686961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb6a9-948f-4947-853e-e5c625c55cbe None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:54.687393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb6a9-948f-4947-853e-e5c625c55cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:54.687838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb6a9-948f-4947-853e-e5c625c55cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:54.706748 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082eb6a9-948f-4947-853e-e5c625c55cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:54.708693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082eb6a9-948f-4947-853e-e5c625c55cbe None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-082eb6a9-948f-4947-853e-e5c625c55cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:54.729722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:54.730832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:54.731803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:54.731803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:54.731803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:54.733929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 372/724] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:54.739347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caada97-c48d-4c78-ad5f-1254f98962b8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:54.908057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caada97-c48d-4c78-ad5f-1254f98962b8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:54.943489 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:54.961691 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ebb09-2af1-4d6b-988b-79a3629430ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:54.962322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ebb09-2af1-4d6b-988b-79a3629430ca None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:54.962608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ebb09-2af1-4d6b-988b-79a3629430ca None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:54.962886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ebb09-2af1-4d6b-988b-79a3629430ca None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:54.963541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ebb09-2af1-4d6b-988b-79a3629430ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:54.963849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ebb09-2af1-4d6b-988b-79a3629430ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:54.965238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ebb09-2af1-4d6b-988b-79a3629430ca None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:54.984060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 353/725] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:54.990020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb6a9-948f-4947-853e-e5c625c55cbe None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:55.025459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:55.113183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb6a9-948f-4947-853e-e5c625c55cbe None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:55.157048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65458023-fd5e-4e3e-8de7-d89678818ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:55.157708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458023-fd5e-4e3e-8de7-d89678818ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:55.157995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458023-fd5e-4e3e-8de7-d89678818ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:55.158346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458023-fd5e-4e3e-8de7-d89678818ea6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:55.166932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65458023-fd5e-4e3e-8de7-d89678818ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:55.168421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65458023-fd5e-4e3e-8de7-d89678818ea6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-65458023-fd5e-4e3e-8de7-d89678818ea6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:55.184119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:55.185965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:55.192474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 373/726] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Aug 31 00:55:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:55.194864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ebb09-2af1-4d6b-988b-79a3629430ca None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:55.429629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ebb09-2af1-4d6b-988b-79a3629430ca None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:55.494518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44baa2-11b4-42c4-94f9-7bfc9e0a0148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:55.495539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44baa2-11b4-42c4-94f9-7bfc9e0a0148 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:55.496081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44baa2-11b4-42c4-94f9-7bfc9e0a0148 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:55.496617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44baa2-11b4-42c4-94f9-7bfc9e0a0148 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:55.497650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44baa2-11b4-42c4-94f9-7bfc9e0a0148 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:55.498182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44baa2-11b4-42c4-94f9-7bfc9e0a0148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:55.499822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44baa2-11b4-42c4-94f9-7bfc9e0a0148 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:55.539174 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 354/727] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Aug 31 00:55:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:55.553472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65458023-fd5e-4e3e-8de7-d89678818ea6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:55.696046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:55.727664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65458023-fd5e-4e3e-8de7-d89678818ea6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:55.775672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d27a5-6476-4dd7-9c7e-38088fc23f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:55.776292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d27a5-6476-4dd7-9c7e-38088fc23f78 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:55.776599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d27a5-6476-4dd7-9c7e-38088fc23f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:55.776876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d27a5-6476-4dd7-9c7e-38088fc23f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:55.875783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d27a5-6476-4dd7-9c7e-38088fc23f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:55.877267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d27a5-6476-4dd7-9c7e-38088fc23f78 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:55.895861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f411b-93fc-4fb7-92e5-2ea2fd8d8a78 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:55.896862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f411b-93fc-4fb7-92e5-2ea2fd8d8a78 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:55.897346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f411b-93fc-4fb7-92e5-2ea2fd8d8a78 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:55.899916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 355/728] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:55.905016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14975364-be4f-433e-a5be-06f55e1a985d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:55.905568 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14975364-be4f-433e-a5be-06f55e1a985d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:55.906071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14975364-be4f-433e-a5be-06f55e1a985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:55.941356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-14975364-be4f-433e-a5be-06f55e1a985d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:55.942943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-14975364-be4f-433e-a5be-06f55e1a985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:55.963056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:55.988388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 374/729] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:55.989761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3896e-7ab7-4088-826c-97c69ad7931a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:55.990234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3896e-7ab7-4088-826c-97c69ad7931a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:55.990514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3896e-7ab7-4088-826c-97c69ad7931a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:55.992123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 375/730] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:55.997324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:55.999618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d42d9-1449-458c-99e0-36a555b82d65 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:55.999910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d42d9-1449-458c-99e0-36a555b82d65 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:56.000196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d42d9-1449-458c-99e0-36a555b82d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:56.022566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-668d42d9-1449-458c-99e0-36a555b82d65 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:56.024197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-668d42d9-1449-458c-99e0-36a555b82d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:56.025924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 356/731] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:56.026977 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14975364-be4f-433e-a5be-06f55e1a985d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:56.121134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 376/732] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:56.199505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14975364-be4f-433e-a5be-06f55e1a985d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:56.250413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28322e6e-a442-4cc0-814f-e714734bb1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:56.251437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28322e6e-a442-4cc0-814f-e714734bb1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:56.252017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28322e6e-a442-4cc0-814f-e714734bb1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:56.252515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28322e6e-a442-4cc0-814f-e714734bb1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:56.270030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28322e6e-a442-4cc0-814f-e714734bb1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:56.271800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28322e6e-a442-4cc0-814f-e714734bb1f2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-28322e6e-a442-4cc0-814f-e714734bb1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:56.293324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:56.294325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:56.295192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:56.295192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:56.295192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:56.296983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 357/733] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:56.302580 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d42d9-1449-458c-99e0-36a555b82d65 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:56.447897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d42d9-1449-458c-99e0-36a555b82d65 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:56.457553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:56.483394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af0c8-7829-4825-966b-76ffab977a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:56.484019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af0c8-7829-4825-966b-76ffab977a91 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:56.484302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af0c8-7829-4825-966b-76ffab977a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:56.484605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af0c8-7829-4825-966b-76ffab977a91 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:56.485261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2af0c8-7829-4825-966b-76ffab977a91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:56.485569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2af0c8-7829-4825-966b-76ffab977a91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:56.487013 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2af0c8-7829-4825-966b-76ffab977a91 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:56.498490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28322e6e-a442-4cc0-814f-e714734bb1f2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:56.503463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 377/734] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:56.517255 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af0c8-7829-4825-966b-76ffab977a91 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:56.535046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:56.623960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af0c8-7829-4825-966b-76ffab977a91 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:56.629409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28322e6e-a442-4cc0-814f-e714734bb1f2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:56.667258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b012c5e-842a-4ff8-8b41-730d483f17ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:56.667897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b012c5e-842a-4ff8-8b41-730d483f17ab None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:56.668174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b012c5e-842a-4ff8-8b41-730d483f17ab None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:56.668488 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b012c5e-842a-4ff8-8b41-730d483f17ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:56.672265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9c808-fdae-4b30-bc21-422a5893cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:56.673153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9c808-fdae-4b30-bc21-422a5893cf83 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:56.673594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9c808-fdae-4b30-bc21-422a5893cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:56.674023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9c808-fdae-4b30-bc21-422a5893cf83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:56.676233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b012c5e-842a-4ff8-8b41-730d483f17ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:56.677725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b012c5e-842a-4ff8-8b41-730d483f17ab None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:56.687782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9c808-fdae-4b30-bc21-422a5893cf83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6b012c5e-842a-4ff8-8b41-730d483f17ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:56.690164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:56.691198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:56.697860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:56.697860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:56.697860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:56.697860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:56.697860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:56.697860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:56.697860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:56.697860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:56.697860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 378/735] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:56.697860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b012c5e-842a-4ff8-8b41-730d483f17ab None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d7e9c808-fdae-4b30-bc21-422a5893cf83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:56.698416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:56.699296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 358/736] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:55:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:56.700144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a2c3-7730-4544-94cc-a1ea94aa425a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:56.702921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a2c3-7730-4544-94cc-a1ea94aa425a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:56.702921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a2c3-7730-4544-94cc-a1ea94aa425a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:56.705413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 359/737] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:56.705413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4a2c3-7730-4544-94cc-a1ea94aa425a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:56.740251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:56.824800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b012c5e-842a-4ff8-8b41-730d483f17ab None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:56.827671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:56.853170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4a2c3-7730-4544-94cc-a1ea94aa425a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:56.865609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e466c5b-8517-4c25-a5b1-2cea1b3c70b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:56.866229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e466c5b-8517-4c25-a5b1-2cea1b3c70b9 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:56.867091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e466c5b-8517-4c25-a5b1-2cea1b3c70b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:56.867467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e466c5b-8517-4c25-a5b1-2cea1b3c70b9 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:56.868147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e466c5b-8517-4c25-a5b1-2cea1b3c70b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:56.869549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e466c5b-8517-4c25-a5b1-2cea1b3c70b9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:56.893717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 379/738] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:55:56 2022] POST /identity/v3/services => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:55:56.894921 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e466c5b-8517-4c25-a5b1-2cea1b3c70b9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:56.927610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbc17f-bacf-455b-92b5-5433274e1aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:56.930039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbc17f-bacf-455b-92b5-5433274e1aef None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:56.930637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbc17f-bacf-455b-92b5-5433274e1aef None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:56.931121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbc17f-bacf-455b-92b5-5433274e1aef None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:56.932074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbc17f-bacf-455b-92b5-5433274e1aef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:56.932843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbc17f-bacf-455b-92b5-5433274e1aef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:56.934779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbc17f-bacf-455b-92b5-5433274e1aef None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:56.952016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 360/739] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:56.954080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980b2eb-108f-4cc9-92d2-e2155546cdcf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:56.955070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980b2eb-108f-4cc9-92d2-e2155546cdcf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:56.955554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980b2eb-108f-4cc9-92d2-e2155546cdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:56.978689 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3980b2eb-108f-4cc9-92d2-e2155546cdcf None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:56.980354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3980b2eb-108f-4cc9-92d2-e2155546cdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:57.074389 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 361/740] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:57.075886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980b2eb-108f-4cc9-92d2-e2155546cdcf None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:57.081251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:57.094817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e466c5b-8517-4c25-a5b1-2cea1b3c70b9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:57.153577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d91c8-8481-4f32-814a-282a9a20b171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:57.155524 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d91c8-8481-4f32-814a-282a9a20b171 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:57.156818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d91c8-8481-4f32-814a-282a9a20b171 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:57.157850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d91c8-8481-4f32-814a-282a9a20b171 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:57.159612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d91c8-8481-4f32-814a-282a9a20b171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:57.161047 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d91c8-8481-4f32-814a-282a9a20b171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:57.165692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d91c8-8481-4f32-814a-282a9a20b171 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:57.185117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:57.185931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 380/741] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:57.192359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a8afa-4287-4a8f-a8de-b42d063adc3a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:57.192359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a8afa-4287-4a8f-a8de-b42d063adc3a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:57.192359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a8afa-4287-4a8f-a8de-b42d063adc3a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:57.194308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 381/742] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:57.197564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a4e7-1bfe-4407-a13f-550d5f2fe898 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:57.197852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a4e7-1bfe-4407-a13f-550d5f2fe898 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:57.198140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a4e7-1bfe-4407-a13f-550d5f2fe898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:57.221419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3510a4e7-1bfe-4407-a13f-550d5f2fe898 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:57.222726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3510a4e7-1bfe-4407-a13f-550d5f2fe898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:57.236471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980b2eb-108f-4cc9-92d2-e2155546cdcf None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:57.280656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401934cb-fc33-41ba-9bcb-5d156d9074d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:57.281279 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401934cb-fc33-41ba-9bcb-5d156d9074d9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:57.281560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401934cb-fc33-41ba-9bcb-5d156d9074d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:57.281834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401934cb-fc33-41ba-9bcb-5d156d9074d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:57.282570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401934cb-fc33-41ba-9bcb-5d156d9074d9 None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=4f7bdd26be524f6e8354e6fbdcd50136) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:57.282884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401934cb-fc33-41ba-9bcb-5d156d9074d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:57.284339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401934cb-fc33-41ba-9bcb-5d156d9074d9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:57.299142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 362/743] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:55:57 2022] GET /identity/v3/role_assignments?user.id=4f7bdd26be524f6e8354e6fbdcd50136&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:57.299142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401934cb-fc33-41ba-9bcb-5d156d9074d9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:57.322759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 382/744] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:57 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:55:57.412149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a4e7-1bfe-4407-a13f-550d5f2fe898 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:57.497439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401934cb-fc33-41ba-9bcb-5d156d9074d9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:57.536743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:57.544766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:57.546647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14626637-b862-47db-b3c3-c50c805962bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:57.547404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14626637-b862-47db-b3c3-c50c805962bd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:57.548541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14626637-b862-47db-b3c3-c50c805962bd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:57.548541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14626637-b862-47db-b3c3-c50c805962bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:57.560217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14626637-b862-47db-b3c3-c50c805962bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:57.561829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14626637-b862-47db-b3c3-c50c805962bd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:57.574551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a4e7-1bfe-4407-a13f-550d5f2fe898 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-14626637-b862-47db-b3c3-c50c805962bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:57.587774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:57.588915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:57.589831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:57.589831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:57.589831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:57.593736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 363/745] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:57.602036 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14626637-b862-47db-b3c3-c50c805962bd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:57.612356 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c02118-e982-4be5-ae03-48d129ca5321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:57.613000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c02118-e982-4be5-ae03-48d129ca5321 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:57.613287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c02118-e982-4be5-ae03-48d129ca5321 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:57.613566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c02118-e982-4be5-ae03-48d129ca5321 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:57.614234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c02118-e982-4be5-ae03-48d129ca5321 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:57.615604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c02118-e982-4be5-ae03-48d129ca5321 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:57.641917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 383/746] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:55:57 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:55:57.742524 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c02118-e982-4be5-ae03-48d129ca5321 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:57.794843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14626637-b862-47db-b3c3-c50c805962bd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:57.877096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d2d23-d55c-41bc-b561-33c91bc55b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:57.877886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d2d23-d55c-41bc-b561-33c91bc55b12 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:57.878176 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d2d23-d55c-41bc-b561-33c91bc55b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:57.878454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d2d23-d55c-41bc-b561-33c91bc55b12 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:57.879215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d2d23-d55c-41bc-b561-33c91bc55b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:57.879527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d2d23-d55c-41bc-b561-33c91bc55b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:57.880935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d2d23-d55c-41bc-b561-33c91bc55b12 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:57.895130 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 364/747] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:57.901671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d2d23-d55c-41bc-b561-33c91bc55b12 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:57.905062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c02118-e982-4be5-ae03-48d129ca5321 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:57.949892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:57.950420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84a97b-5f8d-4bc0-bcd4-09dd7ca83c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:57.950977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84a97b-5f8d-4bc0-bcd4-09dd7ca83c35 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:57.951310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84a97b-5f8d-4bc0-bcd4-09dd7ca83c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:57.951553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84a97b-5f8d-4bc0-bcd4-09dd7ca83c35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:57.961590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:57.966017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84a97b-5f8d-4bc0-bcd4-09dd7ca83c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-dd84a97b-5f8d-4bc0-bcd4-09dd7ca83c35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:55:57.972653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:57.973572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:55:57.974482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:57.975109 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 384/748] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:55:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:57.981110 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84a97b-5f8d-4bc0-bcd4-09dd7ca83c35 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:58.027958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d2d23-d55c-41bc-b561-33c91bc55b12 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:58.072486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af135-ff85-4dcd-875a-f783ce7f0cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:58.073164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af135-ff85-4dcd-875a-f783ce7f0cef None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:58.073446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af135-ff85-4dcd-875a-f783ce7f0cef None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:58.073723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af135-ff85-4dcd-875a-f783ce7f0cef None admin] PATH_INFO: `/v3/users/swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:58.082909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af135-ff85-4dcd-875a-f783ce7f0cef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:58.084409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af135-ff85-4dcd-875a-f783ce7f0cef None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-347af135-ff85-4dcd-875a-f783ce7f0cef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:58.098274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:58.100303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:58.102721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 365/749] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:55:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:58.112374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af135-ff85-4dcd-875a-f783ce7f0cef None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:58.131002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84a97b-5f8d-4bc0-bcd4-09dd7ca83c35 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:58.191898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb957c-749e-4815-bac5-2077bcfc30cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:58.192560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb957c-749e-4815-bac5-2077bcfc30cc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:58.192844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb957c-749e-4815-bac5-2077bcfc30cc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:58.193120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb957c-749e-4815-bac5-2077bcfc30cc None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:58.193819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb957c-749e-4815-bac5-2077bcfc30cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:58.194133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb957c-749e-4815-bac5-2077bcfc30cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:58.195695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb957c-749e-4815-bac5-2077bcfc30cc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:58.223442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 385/750] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:55:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:58.227676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb957c-749e-4815-bac5-2077bcfc30cc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:58.272584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:58.276715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af135-ff85-4dcd-875a-f783ce7f0cef None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:58.313131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:58.353085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb957c-749e-4815-bac5-2077bcfc30cc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:58.364696 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fc997-6d0b-4edf-9207-d003440c0cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:58.365321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fc997-6d0b-4edf-9207-d003440c0cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:58.365609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fc997-6d0b-4edf-9207-d003440c0cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:58.365886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fc997-6d0b-4edf-9207-d003440c0cb9 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:58.367288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fc997-6d0b-4edf-9207-d003440c0cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:58.367600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fc997-6d0b-4edf-9207-d003440c0cb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:58.369075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fc997-6d0b-4edf-9207-d003440c0cb9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:58.399321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 366/751] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Aug 31 00:55:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:58.411621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fc997-6d0b-4edf-9207-d003440c0cb9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:58.417778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742e3f7-dfbe-4019-a5b2-cfef5d78bf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:58.418694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742e3f7-dfbe-4019-a5b2-cfef5d78bf90 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:58.419201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742e3f7-dfbe-4019-a5b2-cfef5d78bf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:58.419676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742e3f7-dfbe-4019-a5b2-cfef5d78bf90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:58.443298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742e3f7-dfbe-4019-a5b2-cfef5d78bf90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:58.446543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742e3f7-dfbe-4019-a5b2-cfef5d78bf90 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b742e3f7-dfbe-4019-a5b2-cfef5d78bf90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:58.475594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:58.477182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:58.478082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:58.478082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:58.478082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:58.483756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 386/752] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:58.488364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742e3f7-dfbe-4019-a5b2-cfef5d78bf90 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:58.627756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742e3f7-dfbe-4019-a5b2-cfef5d78bf90 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:58.630273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fc997-6d0b-4edf-9207-d003440c0cb9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:58.663079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:58.679517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b253c9d-ad61-42e8-8742-03383125d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:58.680140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253c9d-ad61-42e8-8742-03383125d906 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:58.680459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253c9d-ad61-42e8-8742-03383125d906 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:58.680845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253c9d-ad61-42e8-8742-03383125d906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:58.705197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95223d76-6540-40ab-9dce-ff99d537c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:58.705819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95223d76-6540-40ab-9dce-ff99d537c466 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:58.706099 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95223d76-6540-40ab-9dce-ff99d537c466 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:58.706376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95223d76-6540-40ab-9dce-ff99d537c466 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:58.707125 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95223d76-6540-40ab-9dce-ff99d537c466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:58.707535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95223d76-6540-40ab-9dce-ff99d537c466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:58.708940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95223d76-6540-40ab-9dce-ff99d537c466 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:58.709909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:58.743602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 387/753] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:58.760545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95223d76-6540-40ab-9dce-ff99d537c466 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:58.761497 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b253c9d-ad61-42e8-8742-03383125d906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:58.762948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b253c9d-ad61-42e8-8742-03383125d906 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:58.870055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 367/754] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:55:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:55:58.875585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b253c9d-ad61-42e8-8742-03383125d906 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:58.942544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:58.993213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b253c9d-ad61-42e8-8742-03383125d906 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:59.025428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95223d76-6540-40ab-9dce-ff99d537c466 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:59.037294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f8f12-ffe1-4603-9b37-3468afaad967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:59.038009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f8f12-ffe1-4603-9b37-3468afaad967 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.038330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f8f12-ffe1-4603-9b37-3468afaad967 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.038651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f8f12-ffe1-4603-9b37-3468afaad967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.050214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f8f12-ffe1-4603-9b37-3468afaad967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:59.052363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f8f12-ffe1-4603-9b37-3468afaad967 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-a77f8f12-ffe1-4603-9b37-3468afaad967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:59.070923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:59.071934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:59.072857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:59.072857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:59.072857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:59.072857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 368/755] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:59.079664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f8f12-ffe1-4603-9b37-3468afaad967 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:59.095068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7093-1d7f-428e-a63a-8d7444636b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:59.095718 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7093-1d7f-428e-a63a-8d7444636b1f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.096052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7093-1d7f-428e-a63a-8d7444636b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.096354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7093-1d7f-428e-a63a-8d7444636b1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.112725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf7093-1d7f-428e-a63a-8d7444636b1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:59.114211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf7093-1d7f-428e-a63a-8d7444636b1f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c9cf7093-1d7f-428e-a63a-8d7444636b1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:55:59.141383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:59.143638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:59.146041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:59.146041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:59.146041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:55:59.146041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:55:59.146041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:55:59.146041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:55:59.146041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:55:59.146041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:55:59.146041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:55:59.146041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:59.152647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 388/756] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Aug 31 00:55:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:55:59.162589 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7093-1d7f-428e-a63a-8d7444636b1f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:59.215728 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:59.286400 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7093-1d7f-428e-a63a-8d7444636b1f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:59.331061 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bf978-ed23-4b4e-a7f3-e896b3121459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:59.331679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf978-ed23-4b4e-a7f3-e896b3121459 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.331963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf978-ed23-4b4e-a7f3-e896b3121459 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.332241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf978-ed23-4b4e-a7f3-e896b3121459 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.332363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f8f12-ffe1-4603-9b37-3468afaad967 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:59.333006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bf978-ed23-4b4e-a7f3-e896b3121459 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:59.333312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bf978-ed23-4b4e-a7f3-e896b3121459 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:59.336415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bf978-ed23-4b4e-a7f3-e896b3121459 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:59.344503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:59.360675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 389/757] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Aug 31 00:55:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:55:59.362652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3929374-6eff-483d-826e-cb1c3241d3d7 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.362941 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3929374-6eff-483d-826e-cb1c3241d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.363220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3929374-6eff-483d-826e-cb1c3241d3d7 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.365543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 390/758] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:59.366634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3929374-6eff-483d-826e-cb1c3241d3d7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:59.374412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b827a6-d379-4ee6-8c83-a6d57073cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:59.375394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b827a6-d379-4ee6-8c83-a6d57073cf70 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.375912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b827a6-d379-4ee6-8c83-a6d57073cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.376429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b827a6-d379-4ee6-8c83-a6d57073cf70 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.377306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b827a6-d379-4ee6-8c83-a6d57073cf70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:59.377861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b827a6-d379-4ee6-8c83-a6d57073cf70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:59.379463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b827a6-d379-4ee6-8c83-a6d57073cf70 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:59.393724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 369/759] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:59.395295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88147ab-ba8e-4fe4-8984-f8aa54cdbea9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.395801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88147ab-ba8e-4fe4-8984-f8aa54cdbea9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.396290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88147ab-ba8e-4fe4-8984-f8aa54cdbea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.416740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b88147ab-ba8e-4fe4-8984-f8aa54cdbea9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:59.418403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b88147ab-ba8e-4fe4-8984-f8aa54cdbea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:59.481364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:59.494712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3929374-6eff-483d-826e-cb1c3241d3d7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:59.496887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 370/760] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:55:59.497967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88147ab-ba8e-4fe4-8984-f8aa54cdbea9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:59.537892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ffcb-88a4-4b28-a6a8-8682f7623590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:59.539913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ffcb-88a4-4b28-a6a8-8682f7623590 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.540463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ffcb-88a4-4b28-a6a8-8682f7623590 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.540948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ffcb-88a4-4b28-a6a8-8682f7623590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.555661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409ffcb-88a4-4b28-a6a8-8682f7623590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:59.557776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409ffcb-88a4-4b28-a6a8-8682f7623590 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c409ffcb-88a4-4b28-a6a8-8682f7623590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:55:59.593311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:59.594553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:55:59.595449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:55:59.595449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:55:59.595449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:55:59.595449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 391/761] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:59.603534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ffcb-88a4-4b28-a6a8-8682f7623590 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:59.645755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:59.650783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88147ab-ba8e-4fe4-8984-f8aa54cdbea9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:59.696415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea738d5-680c-422e-a0f0-fc8f01cfaa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:59.697321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea738d5-680c-422e-a0f0-fc8f01cfaa13 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.697611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea738d5-680c-422e-a0f0-fc8f01cfaa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.697886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea738d5-680c-422e-a0f0-fc8f01cfaa13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.707198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea738d5-680c-422e-a0f0-fc8f01cfaa13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:59.708683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea738d5-680c-422e-a0f0-fc8f01cfaa13 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4ea738d5-680c-422e-a0f0-fc8f01cfaa13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:55:59.724543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:55:59.725511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:55:59.727372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:55:59.727372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:55:59.727372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:55:59.727372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:55:59.727372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:55:59.727372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:55:59.727372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:55:59.727372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:55:59.727372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 371/762] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:55:59.728394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17ba1-2ee5-4c31-8e4a-c44129635f65 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.735569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17ba1-2ee5-4c31-8e4a-c44129635f65 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.735569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17ba1-2ee5-4c31-8e4a-c44129635f65 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.735569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 372/763] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:55:59.735569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17ba1-2ee5-4c31-8e4a-c44129635f65 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:59.754482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ffcb-88a4-4b28-a6a8-8682f7623590 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:59.802651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b83ea9-ea55-491b-9299-47710af81de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:59.803654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b83ea9-ea55-491b-9299-47710af81de2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.804743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b83ea9-ea55-491b-9299-47710af81de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.805286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b83ea9-ea55-491b-9299-47710af81de2 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.806410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b83ea9-ea55-491b-9299-47710af81de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:59.807320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b83ea9-ea55-491b-9299-47710af81de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:59.808767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b83ea9-ea55-491b-9299-47710af81de2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:59.821273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 392/764] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:59.827230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884bc0-4f3f-4f7c-bee1-3c7d68b998ac None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.827522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884bc0-4f3f-4f7c-bee1-3c7d68b998ac None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.827798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884bc0-4f3f-4f7c-bee1-3c7d68b998ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.834935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:59.846834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c5884bc0-4f3f-4f7c-bee1-3c7d68b998ac None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:55:59.848033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c5884bc0-4f3f-4f7c-bee1-3c7d68b998ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:55:59.864921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17ba1-2ee5-4c31-8e4a-c44129635f65 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:55:59.904469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1734e1-74f8-4025-b0d9-ae98a8059b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:55:59.905096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1734e1-74f8-4025-b0d9-ae98a8059b84 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:55:59.905628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1734e1-74f8-4025-b0d9-ae98a8059b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:55:59.905628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1734e1-74f8-4025-b0d9-ae98a8059b84 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:55:59.906348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1734e1-74f8-4025-b0d9-ae98a8059b84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:55:59.906662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1734e1-74f8-4025-b0d9-ae98a8059b84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:55:59.908108 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1734e1-74f8-4025-b0d9-ae98a8059b84 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:55:59.924446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 373/765] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:55:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:55:59.924446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1734e1-74f8-4025-b0d9-ae98a8059b84 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:59.940350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 393/766] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:55:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:55:59.940350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5884bc0-4f3f-4f7c-bee1-3c7d68b998ac None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:55:59.959316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:00.051233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1734e1-74f8-4025-b0d9-ae98a8059b84 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:00.066102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5884bc0-4f3f-4f7c-bee1-3c7d68b998ac None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:00.089300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773e2a-594e-4f39-8201-ee853bc7d66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:00.089951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773e2a-594e-4f39-8201-ee853bc7d66f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.090242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773e2a-594e-4f39-8201-ee853bc7d66f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.090591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773e2a-594e-4f39-8201-ee853bc7d66f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.091636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad773e2a-594e-4f39-8201-ee853bc7d66f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:00.093202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad773e2a-594e-4f39-8201-ee853bc7d66f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ad773e2a-594e-4f39-8201-ee853bc7d66f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:00.104224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:00.105291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:56:00.106127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:00.106938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91e2b9-1a00-4930-b74d-bf5001234a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:00.106938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e2b9-1a00-4930-b74d-bf5001234a5d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.106938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e2b9-1a00-4930-b74d-bf5001234a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.106938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e2b9-1a00-4930-b74d-bf5001234a5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.107212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 374/767] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Aug 31 00:55:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:00.107212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773e2a-594e-4f39-8201-ee853bc7d66f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:00.112478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:00.119148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91e2b9-1a00-4930-b74d-bf5001234a5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:00.121161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91e2b9-1a00-4930-b74d-bf5001234a5d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9d91e2b9-1a00-4930-b74d-bf5001234a5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:00.138174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:00.139139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:00.140011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:00.140011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:00.140011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:00.140011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:00.140011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:00.140011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:00.140011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:00.140011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:00.140011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 394/768] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:55:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:00.140522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e3cf-1d47-4e8e-b20e-46549b03bf74 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.141071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e3cf-1d47-4e8e-b20e-46549b03bf74 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.141071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e3cf-1d47-4e8e-b20e-46549b03bf74 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.144449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 395/769] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:00.144449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e3cf-1d47-4e8e-b20e-46549b03bf74 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:00.214185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:00.232706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773e2a-594e-4f39-8201-ee853bc7d66f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:00.255989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e3cf-1d47-4e8e-b20e-46549b03bf74 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:00.292874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00bc2c-a88d-4c20-a635-8f6e45ce2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:00.293499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00bc2c-a88d-4c20-a635-8f6e45ce2e96 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.293779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00bc2c-a88d-4c20-a635-8f6e45ce2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.294053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00bc2c-a88d-4c20-a635-8f6e45ce2e96 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.294699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00bc2c-a88d-4c20-a635-8f6e45ce2e96 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:00.295005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00bc2c-a88d-4c20-a635-8f6e45ce2e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:00.296423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00bc2c-a88d-4c20-a635-8f6e45ce2e96 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:00.301587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 396/770] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Aug 31 00:56:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:00.302356 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00bc2c-a88d-4c20-a635-8f6e45ce2e96 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:00.366893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:00.383585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f076e-2472-4055-9754-3016a661ab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:00.384198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f076e-2472-4055-9754-3016a661ab0b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.384518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f076e-2472-4055-9754-3016a661ab0b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.384798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f076e-2472-4055-9754-3016a661ab0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.385535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f076e-2472-4055-9754-3016a661ab0b None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=814473b735314e4cb2321e952777031c) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:00.385852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f076e-2472-4055-9754-3016a661ab0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:00.387302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f076e-2472-4055-9754-3016a661ab0b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:00.392947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 375/771] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:00 2022] GET /identity/v3/role_assignments?user.id=814473b735314e4cb2321e952777031c&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:00.394089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dca66-7577-4e01-ab00-23552fbfb153 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.394366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dca66-7577-4e01-ab00-23552fbfb153 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.394651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dca66-7577-4e01-ab00-23552fbfb153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.412171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00bc2c-a88d-4c20-a635-8f6e45ce2e96 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:00.427367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f98dca66-7577-4e01-ab00-23552fbfb153 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:00.428682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f98dca66-7577-4e01-ab00-23552fbfb153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:00.454300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070643d-a6ee-496b-a229-53fdcdb88c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:00.454930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070643d-a6ee-496b-a229-53fdcdb88c17 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.455218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070643d-a6ee-496b-a229-53fdcdb88c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.455507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070643d-a6ee-496b-a229-53fdcdb88c17 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.456220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070643d-a6ee-496b-a229-53fdcdb88c17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:00.456580 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070643d-a6ee-496b-a229-53fdcdb88c17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:00.458056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070643d-a6ee-496b-a229-53fdcdb88c17 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:00.473633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 397/772] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:00.474787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070643d-a6ee-496b-a229-53fdcdb88c17 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:00.512649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 376/773] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:00.513790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dca66-7577-4e01-ab00-23552fbfb153 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:00.610051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070643d-a6ee-496b-a229-53fdcdb88c17 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:00.621246 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:00.637406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:00.648741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dca66-7577-4e01-ab00-23552fbfb153 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:00.662183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7c278-7e95-4e50-8a0b-f059e6ef2462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:00.662833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7c278-7e95-4e50-8a0b-f059e6ef2462 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.663144 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7c278-7e95-4e50-8a0b-f059e6ef2462 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.664289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7c278-7e95-4e50-8a0b-f059e6ef2462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.678621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7c278-7e95-4e50-8a0b-f059e6ef2462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-28d7c278-7e95-4e50-8a0b-f059e6ef2462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:00.684303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:00.685270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:56:00.686097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:00.692661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cda67-9cd0-4a51-bb2b-9b89045ad5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:00.692661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cda67-9cd0-4a51-bb2b-9b89045ad5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.692661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cda67-9cd0-4a51-bb2b-9b89045ad5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.692661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cda67-9cd0-4a51-bb2b-9b89045ad5a6 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.693034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cda67-9cd0-4a51-bb2b-9b89045ad5a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:00.693034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cda67-9cd0-4a51-bb2b-9b89045ad5a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:00.693034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cda67-9cd0-4a51-bb2b-9b89045ad5a6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:00.693567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 398/774] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:56:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:00.694588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7c278-7e95-4e50-8a0b-f059e6ef2462 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:00.699002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 377/775] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Aug 31 00:56:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:00.703367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cda67-9cd0-4a51-bb2b-9b89045ad5a6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:00.821282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cda67-9cd0-4a51-bb2b-9b89045ad5a6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:00.823710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7c278-7e95-4e50-8a0b-f059e6ef2462 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:00.860775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98044e-635e-4593-bd40-fb34b6366775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:00.861629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98044e-635e-4593-bd40-fb34b6366775 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.861916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98044e-635e-4593-bd40-fb34b6366775 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.862194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98044e-635e-4593-bd40-fb34b6366775 None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/a99d74d9d72c4fc2a363ce6559e4ddff/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.863641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606111ec-749b-4493-b5fb-12ec1e32692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:00.864082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98044e-635e-4593-bd40-fb34b6366775 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=a99d74d9d72c4fc2a363ce6559e4ddff, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:00.864261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606111ec-749b-4493-b5fb-12ec1e32692a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:00.864657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606111ec-749b-4493-b5fb-12ec1e32692a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:00.864943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606111ec-749b-4493-b5fb-12ec1e32692a None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:00.865546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98044e-635e-4593-bd40-fb34b6366775 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:00.865657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606111ec-749b-4493-b5fb-12ec1e32692a None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:00.865973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606111ec-749b-4493-b5fb-12ec1e32692a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:00.867708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606111ec-749b-4493-b5fb-12ec1e32692a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:00.880531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 378/776] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:56:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:00.880531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606111ec-749b-4493-b5fb-12ec1e32692a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:00.881378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:00.892352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 399/777] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:56:00 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/a99d74d9d72c4fc2a363ce6559e4ddff/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:56:00.892352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98044e-635e-4593-bd40-fb34b6366775 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:00.951498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:01.028046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606111ec-749b-4493-b5fb-12ec1e32692a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:01.046396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98044e-635e-4593-bd40-fb34b6366775 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:01.079965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42035240-0afe-4e19-830f-92a38cb6d594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:01.081216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42035240-0afe-4e19-830f-92a38cb6d594 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:01.081642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42035240-0afe-4e19-830f-92a38cb6d594 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:01.082055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42035240-0afe-4e19-830f-92a38cb6d594 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:01.082929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42035240-0afe-4e19-830f-92a38cb6d594 None admin] RBAC: Adding query filter params (interface=public, service_id=5e8cab99ac5b4c7c966f871ba8b51ef2, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:01.083241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42035240-0afe-4e19-830f-92a38cb6d594 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:01.084678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42035240-0afe-4e19-830f-92a38cb6d594 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:01.093200 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 379/778] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Aug 31 00:56:00 2022] GET /identity/v3/endpoints?service_id=5e8cab99ac5b4c7c966f871ba8b51ef2&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:01.093865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42035240-0afe-4e19-830f-92a38cb6d594 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:01.095225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0860cf2-c5bc-484a-b17d-aa42f8c392f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:01.096098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0860cf2-c5bc-484a-b17d-aa42f8c392f7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:01.096610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0860cf2-c5bc-484a-b17d-aa42f8c392f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:01.097073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0860cf2-c5bc-484a-b17d-aa42f8c392f7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:01.097848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0860cf2-c5bc-484a-b17d-aa42f8c392f7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:01.099524 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0860cf2-c5bc-484a-b17d-aa42f8c392f7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c0860cf2-c5bc-484a-b17d-aa42f8c392f7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:01.112598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:01.113717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:56:01.114610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:01.119105 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 400/779] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:00 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:01.120506 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0860cf2-c5bc-484a-b17d-aa42f8c392f7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:01.183646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:01.230654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42035240-0afe-4e19-830f-92a38cb6d594 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:01.247271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0860cf2-c5bc-484a-b17d-aa42f8c392f7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:01.249005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:01.284136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcd6e8-d280-4c66-b945-3ccb4b257e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:01.285493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcd6e8-d280-4c66-b945-3ccb4b257e5e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:01.286172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcd6e8-d280-4c66-b945-3ccb4b257e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:01.286707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcd6e8-d280-4c66-b945-3ccb4b257e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:01.290600 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9290d-e625-4bc2-85b3-b53fac904aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:01.291345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9290d-e625-4bc2-85b3-b53fac904aae None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:01.291793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9290d-e625-4bc2-85b3-b53fac904aae None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:01.292073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9290d-e625-4bc2-85b3-b53fac904aae None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:01.292817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9290d-e625-4bc2-85b3-b53fac904aae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:01.294279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9290d-e625-4bc2-85b3-b53fac904aae None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:01.301596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcd6e8-d280-4c66-b945-3ccb4b257e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:01.303314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcd6e8-d280-4c66-b945-3ccb4b257e5e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:01.304949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 401/780] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Aug 31 00:56:01 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:01.306114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9290d-e625-4bc2-85b3-b53fac904aae None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b3fcd6e8-d280-4c66-b945-3ccb4b257e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:01.324019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:01.325293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:01.326415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:01.326415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:01.326415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:01.328172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 380/781] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:01.333672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcd6e8-d280-4c66-b945-3ccb4b257e5e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:01.472375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcd6e8-d280-4c66-b945-3ccb4b257e5e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:01.499484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:01.518877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f452e6-4691-4606-9401-e82670b16c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:01.520023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f452e6-4691-4606-9401-e82670b16c3e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:01.520338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f452e6-4691-4606-9401-e82670b16c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:01.520638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f452e6-4691-4606-9401-e82670b16c3e None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:01.522073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f452e6-4691-4606-9401-e82670b16c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:01.522073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f452e6-4691-4606-9401-e82670b16c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:01.524259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f452e6-4691-4606-9401-e82670b16c3e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:01.541682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 381/782] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:01.543767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9290d-e625-4bc2-85b3-b53fac904aae None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:01.548388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f452e6-4691-4606-9401-e82670b16c3e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:01.590592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e814747-e5a8-4a95-a6c9-a7820a012bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:01.591519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814747-e5a8-4a95-a6c9-a7820a012bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:01.591798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814747-e5a8-4a95-a6c9-a7820a012bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:01.592070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814747-e5a8-4a95-a6c9-a7820a012bc8 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:01.593008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e814747-e5a8-4a95-a6c9-a7820a012bc8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:01.593380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e814747-e5a8-4a95-a6c9-a7820a012bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:01.594854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e814747-e5a8-4a95-a6c9-a7820a012bc8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:01.600928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 402/783] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:01.609320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e814747-e5a8-4a95-a6c9-a7820a012bc8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:01.646743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:01.705081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f452e6-4691-4606-9401-e82670b16c3e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:01.721350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e814747-e5a8-4a95-a6c9-a7820a012bc8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:01.757679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18315c7-7c5d-4e07-abd9-1018cc29dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:01.758645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18315c7-7c5d-4e07-abd9-1018cc29dbca None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:01.759132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18315c7-7c5d-4e07-abd9-1018cc29dbca None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:01.759610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18315c7-7c5d-4e07-abd9-1018cc29dbca None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:01.760489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18315c7-7c5d-4e07-abd9-1018cc29dbca None admin] RBAC: Adding query filter params (type=network) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:01.761002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18315c7-7c5d-4e07-abd9-1018cc29dbca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:01.762581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18315c7-7c5d-4e07-abd9-1018cc29dbca None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:01.768213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 403/784] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:01.773896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb89104-bc8a-484b-b785-1dec4b4af56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:01.774651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb89104-bc8a-484b-b785-1dec4b4af56c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:01.774943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb89104-bc8a-484b-b785-1dec4b4af56c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:01.775226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb89104-bc8a-484b-b785-1dec4b4af56c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:01.775923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18315c7-7c5d-4e07-abd9-1018cc29dbca None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:01.797781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb89104-bc8a-484b-b785-1dec4b4af56c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:01.799166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb89104-bc8a-484b-b785-1dec4b4af56c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-6bb89104-bc8a-484b-b785-1dec4b4af56c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:01.822431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:01.823451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:01.824442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 382/785] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Aug 31 00:56:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:01.832352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb89104-bc8a-484b-b785-1dec4b4af56c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:01.907931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:01.923359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18315c7-7c5d-4e07-abd9-1018cc29dbca None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:01.924627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:01.990369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d05000-5053-4d79-bf25-48eb089d6304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:01.990998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d05000-5053-4d79-bf25-48eb089d6304 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:01.991318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d05000-5053-4d79-bf25-48eb089d6304 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:01.991599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d05000-5053-4d79-bf25-48eb089d6304 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:01.992389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d05000-5053-4d79-bf25-48eb089d6304 None admin] RBAC: Adding query filter params (interface=public, service_id=f107ce457aba4b688709e170a9711634, region_id=RegionOne) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:01.992714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d05000-5053-4d79-bf25-48eb089d6304 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:01.994098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d05000-5053-4d79-bf25-48eb089d6304 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:02.012040 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 404/786] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Aug 31 00:56:01 2022] GET /identity/v3/endpoints?service_id=f107ce457aba4b688709e170a9711634&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:02.014999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d05000-5053-4d79-bf25-48eb089d6304 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:02.032683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb89104-bc8a-484b-b785-1dec4b4af56c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:02.083721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733845f-2722-49f8-9f78-7594f1105ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:02.084416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733845f-2722-49f8-9f78-7594f1105ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:02.084651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733845f-2722-49f8-9f78-7594f1105ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:02.084921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733845f-2722-49f8-9f78-7594f1105ef5 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:02.086537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733845f-2722-49f8-9f78-7594f1105ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:02.086877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733845f-2722-49f8-9f78-7594f1105ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:02.088376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733845f-2722-49f8-9f78-7594f1105ef5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:02.122466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 383/787] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Aug 31 00:56:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:02.128183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733845f-2722-49f8-9f78-7594f1105ef5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:02.174636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d05000-5053-4d79-bf25-48eb089d6304 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:02.220101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97162137-8cdd-4cfd-8bef-d6f31004d509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:02.221134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97162137-8cdd-4cfd-8bef-d6f31004d509 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:02.221619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97162137-8cdd-4cfd-8bef-d6f31004d509 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:02.222092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97162137-8cdd-4cfd-8bef-d6f31004d509 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:02.222899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97162137-8cdd-4cfd-8bef-d6f31004d509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:02.224518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97162137-8cdd-4cfd-8bef-d6f31004d509 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:02.230916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 405/788] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Aug 31 00:56:02 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:02.318689 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:02.323774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733845f-2722-49f8-9f78-7594f1105ef5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:02.376248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd67c7-ee42-4fbb-9f0b-b6f8b34876ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:02.376981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd67c7-ee42-4fbb-9f0b-b6f8b34876ef None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:02.377266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd67c7-ee42-4fbb-9f0b-b6f8b34876ef None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:02.377604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd67c7-ee42-4fbb-9f0b-b6f8b34876ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:02.395224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd67c7-ee42-4fbb-9f0b-b6f8b34876ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:02.396703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd67c7-ee42-4fbb-9f0b-b6f8b34876ef None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-52cd67c7-ee42-4fbb-9f0b-b6f8b34876ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:02.411852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:02.412922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:02.414441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:02.414441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:02.414441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:02.417115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 384/789] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:02.421616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97162137-8cdd-4cfd-8bef-d6f31004d509 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:02.454141 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:02.535816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97162137-8cdd-4cfd-8bef-d6f31004d509 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:02.579758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f6f5b-c3db-460f-a2f9-cfd897c2ff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:02.580709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f6f5b-c3db-460f-a2f9-cfd897c2ff09 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:02.581168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f6f5b-c3db-460f-a2f9-cfd897c2ff09 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:02.581614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f6f5b-c3db-460f-a2f9-cfd897c2ff09 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:02.582460 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f6f5b-c3db-460f-a2f9-cfd897c2ff09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:02.582939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f6f5b-c3db-460f-a2f9-cfd897c2ff09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:02.584495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f6f5b-c3db-460f-a2f9-cfd897c2ff09 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:02.598752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 406/790] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:02.607096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd67c7-ee42-4fbb-9f0b-b6f8b34876ef None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:02.609912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d05d-02ec-40f7-bdfd-f7e5e8befb15 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:02.609912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d05d-02ec-40f7-bdfd-f7e5e8befb15 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:02.609912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d05d-02ec-40f7-bdfd-f7e5e8befb15 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:02.611563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 407/791] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:02.618129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1b149-53a5-4fdf-a957-beca6de8624a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:02.618416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1b149-53a5-4fdf-a957-beca6de8624a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:02.618691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1b149-53a5-4fdf-a957-beca6de8624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:02.661362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4dc1b149-53a5-4fdf-a957-beca6de8624a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:02.662622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4dc1b149-53a5-4fdf-a957-beca6de8624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:02.728045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd67c7-ee42-4fbb-9f0b-b6f8b34876ef None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:02.764720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80772c-8ed6-43c3-b715-f4d094d87a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:02.765746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80772c-8ed6-43c3-b715-f4d094d87a9c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:02.766240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80772c-8ed6-43c3-b715-f4d094d87a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:02.766726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80772c-8ed6-43c3-b715-f4d094d87a9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:02.774599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80772c-8ed6-43c3-b715-f4d094d87a9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:02.776487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80772c-8ed6-43c3-b715-f4d094d87a9c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7c80772c-8ed6-43c3-b715-f4d094d87a9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:02.789067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:02.790317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:02.791225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:02.791225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:02.791225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:02.791225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:02.791225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:02.791225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:02.791225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:02.791225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:02.793607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 385/792] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:02.801975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 408/793] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 31 00:56:02.803367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80772c-8ed6-43c3-b715-f4d094d87a9c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:02.817684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:02.914206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80772c-8ed6-43c3-b715-f4d094d87a9c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:02.951285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affc8ac-5621-4600-a7f1-4d2515613b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:02.952262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affc8ac-5621-4600-a7f1-4d2515613b05 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:02.952780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affc8ac-5621-4600-a7f1-4d2515613b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:02.953265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affc8ac-5621-4600-a7f1-4d2515613b05 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:02.954168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affc8ac-5621-4600-a7f1-4d2515613b05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:02.954706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affc8ac-5621-4600-a7f1-4d2515613b05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:02.956356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affc8ac-5621-4600-a7f1-4d2515613b05 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:02.970829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 386/794] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:02.976939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1b149-53a5-4fdf-a957-beca6de8624a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:03.004629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:03.127471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1b149-53a5-4fdf-a957-beca6de8624a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:03.167423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c9973-e546-482e-85ff-460ea66f1a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:03.168355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c9973-e546-482e-85ff-460ea66f1a34 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:03.168788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c9973-e546-482e-85ff-460ea66f1a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:03.169213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c9973-e546-482e-85ff-460ea66f1a34 None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/4f7bdd26be524f6e8354e6fbdcd50136/roles/7953b234543143eab052272480b952ec` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:03.184893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c9973-e546-482e-85ff-460ea66f1a34 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=4f7bdd26be524f6e8354e6fbdcd50136, role_id=7953b234543143eab052272480b952ec)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:03.186556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c9973-e546-482e-85ff-460ea66f1a34 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:03.213097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 409/795] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:56:02 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/4f7bdd26be524f6e8354e6fbdcd50136/roles/7953b234543143eab052272480b952ec => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:56:03.230671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affc8ac-5621-4600-a7f1-4d2515613b05 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:03.311870 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:03.347949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affc8ac-5621-4600-a7f1-4d2515613b05 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:03.393148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9ac79-6061-4999-b180-7d4fa1d2e488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:03.394226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ac79-6061-4999-b180-7d4fa1d2e488 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:03.394712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ac79-6061-4999-b180-7d4fa1d2e488 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:03.395208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ac79-6061-4999-b180-7d4fa1d2e488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:03.419628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9ac79-6061-4999-b180-7d4fa1d2e488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e5c9ac79-6061-4999-b180-7d4fa1d2e488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:03.428653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:03.429814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:03.430650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:03.433122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 387/796] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:03.440293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c9973-e546-482e-85ff-460ea66f1a34 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:03.486149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cd0bd-d891-43ba-b3e9-b8754c50ab93 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:03.486773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cd0bd-d891-43ba-b3e9-b8754c50ab93 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:03.487243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cd0bd-d891-43ba-b3e9-b8754c50ab93 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:03.489048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 388/797] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:03.494362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfc7e0-f1f8-4bb0-9503-22edef8d6893 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:03.494954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfc7e0-f1f8-4bb0-9503-22edef8d6893 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:03.495457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfc7e0-f1f8-4bb0-9503-22edef8d6893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:03.510579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:03.519671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c6dfc7e0-f1f8-4bb0-9503-22edef8d6893 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:03.521333 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c6dfc7e0-f1f8-4bb0-9503-22edef8d6893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:03.554242 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c9973-e546-482e-85ff-460ea66f1a34 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:03.595601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166d27c-a778-4a3a-b4db-78296a65ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:03.596243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d27c-a778-4a3a-b4db-78296a65ad99 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:03.596585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d27c-a778-4a3a-b4db-78296a65ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:03.596926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d27c-a778-4a3a-b4db-78296a65ad99 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:03.597879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d27c-a778-4a3a-b4db-78296a65ad99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:03.598191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d27c-a778-4a3a-b4db-78296a65ad99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:03.599813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d27c-a778-4a3a-b4db-78296a65ad99 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:03.605443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 389/798] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:03.612365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 410/799] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:03.619560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfc7e0-f1f8-4bb0-9503-22edef8d6893 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:03.684641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:03.687393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a8f18-ef6b-4030-be5c-c6e06d8ba194 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:03.687895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a8f18-ef6b-4030-be5c-c6e06d8ba194 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:03.688359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a8f18-ef6b-4030-be5c-c6e06d8ba194 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:03.689862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 411/800] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:03.696137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b4b5a-66bf-4466-a0e6-959d6263fb97 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:03.696994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b4b5a-66bf-4466-a0e6-959d6263fb97 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:03.697477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b4b5a-66bf-4466-a0e6-959d6263fb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:03.728139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfc7e0-f1f8-4bb0-9503-22edef8d6893 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:03.733965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-609b4b5a-66bf-4466-a0e6-959d6263fb97 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:03.735161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-609b4b5a-66bf-4466-a0e6-959d6263fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:03.767015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4de952-bb59-4c6a-aedd-c30e83e3328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:03.768073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de952-bb59-4c6a-aedd-c30e83e3328f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:03.768556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de952-bb59-4c6a-aedd-c30e83e3328f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:03.768842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de952-bb59-4c6a-aedd-c30e83e3328f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:03.779607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4de952-bb59-4c6a-aedd-c30e83e3328f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:03.781102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4de952-bb59-4c6a-aedd-c30e83e3328f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ce4de952-bb59-4c6a-aedd-c30e83e3328f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:03.797904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:03.799001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:03.799912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:03.799912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:03.799912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:03.799912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 390/801] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:03.804870 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4de952-bb59-4c6a-aedd-c30e83e3328f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:03.909211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 412/802] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:03.910191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b4b5a-66bf-4466-a0e6-959d6263fb97 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:03.948342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4de952-bb59-4c6a-aedd-c30e83e3328f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:03.962755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:03.985868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb165c-53ad-44d4-857c-b29f0108e1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:03.986594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb165c-53ad-44d4-857c-b29f0108e1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:03.986953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb165c-53ad-44d4-857c-b29f0108e1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:03.987293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb165c-53ad-44d4-857c-b29f0108e1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:03.988010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb165c-53ad-44d4-857c-b29f0108e1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:03.988412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb165c-53ad-44d4-857c-b29f0108e1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:03.989851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb165c-53ad-44d4-857c-b29f0108e1a8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:04.003081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 391/803] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:04.009659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb165c-53ad-44d4-857c-b29f0108e1a8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:04.027407 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:04.118476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b4b5a-66bf-4466-a0e6-959d6263fb97 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:04.187073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421220eb-8a78-4f99-8133-cc7aed5dde47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:04.188128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421220eb-8a78-4f99-8133-cc7aed5dde47 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:04.188427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421220eb-8a78-4f99-8133-cc7aed5dde47 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:04.188704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421220eb-8a78-4f99-8133-cc7aed5dde47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:04.206362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421220eb-8a78-4f99-8133-cc7aed5dde47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-421220eb-8a78-4f99-8133-cc7aed5dde47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:04.211351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:04.212415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 413/804] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:04.213560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421220eb-8a78-4f99-8133-cc7aed5dde47 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:04.214501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb165c-53ad-44d4-857c-b29f0108e1a8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:04.261151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2da1e2-2605-4eac-86f9-86d7f7f83a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:04.261864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2da1e2-2605-4eac-86f9-86d7f7f83a84 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:04.262067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2da1e2-2605-4eac-86f9-86d7f7f83a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:04.262352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2da1e2-2605-4eac-86f9-86d7f7f83a84 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:04.270629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2da1e2-2605-4eac-86f9-86d7f7f83a84 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:04.272087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2da1e2-2605-4eac-86f9-86d7f7f83a84 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2c2da1e2-2605-4eac-86f9-86d7f7f83a84 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:04.284692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:04.286615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:04.289391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:04.289391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:04.289391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:04.289391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:04.289391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:04.289391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:04.289391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:04.289391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:04.289391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:56:04.289391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:04.293204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 392/805] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:56:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:04.293204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2da1e2-2605-4eac-86f9-86d7f7f83a84 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:04.323683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421220eb-8a78-4f99-8133-cc7aed5dde47 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:04.326824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:04.338647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:04.362983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791fa85-dec4-4acb-b714-0911958202c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:04.363614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791fa85-dec4-4acb-b714-0911958202c5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:04.363887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791fa85-dec4-4acb-b714-0911958202c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:04.364159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791fa85-dec4-4acb-b714-0911958202c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:04.364791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791fa85-dec4-4acb-b714-0911958202c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:04.366154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791fa85-dec4-4acb-b714-0911958202c5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a791fa85-dec4-4acb-b714-0911958202c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:04.375623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:04.377976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:04.380025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 414/806] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Aug 31 00:56:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:04.388784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791fa85-dec4-4acb-b714-0911958202c5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:04.410474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2da1e2-2605-4eac-86f9-86d7f7f83a84 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:04.452225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39a707-fd6c-4962-8043-a90bdac26be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:04.452899 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a707-fd6c-4962-8043-a90bdac26be3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:04.453250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a707-fd6c-4962-8043-a90bdac26be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:04.453534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a707-fd6c-4962-8043-a90bdac26be3 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:04.454215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39a707-fd6c-4962-8043-a90bdac26be3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:04.454526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39a707-fd6c-4962-8043-a90bdac26be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:04.455903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39a707-fd6c-4962-8043-a90bdac26be3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:04.466731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 393/807] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:56:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:04.467526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39a707-fd6c-4962-8043-a90bdac26be3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:04.487218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791fa85-dec4-4acb-b714-0911958202c5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:04.523623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaf663-f221-4df4-9c8c-b340840922f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:04.524231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf663-f221-4df4-9c8c-b340840922f9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:04.524539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf663-f221-4df4-9c8c-b340840922f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:04.524811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf663-f221-4df4-9c8c-b340840922f9 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:04.525652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaf663-f221-4df4-9c8c-b340840922f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:04.525963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaf663-f221-4df4-9c8c-b340840922f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:04.527506 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaf663-f221-4df4-9c8c-b340840922f9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:04.546646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 415/808] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Aug 31 00:56:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:04.547542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaf663-f221-4df4-9c8c-b340840922f9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:04.579958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:04.589846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39a707-fd6c-4962-8043-a90bdac26be3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:04.590758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:04.629658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146f2cd-8f3e-4ae0-8e91-9ea4ece9eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:04.630667 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146f2cd-8f3e-4ae0-8e91-9ea4ece9eb86 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:04.632546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146f2cd-8f3e-4ae0-8e91-9ea4ece9eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:04.633253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146f2cd-8f3e-4ae0-8e91-9ea4ece9eb86 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:04.634120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146f2cd-8f3e-4ae0-8e91-9ea4ece9eb86 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:04.634652 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146f2cd-8f3e-4ae0-8e91-9ea4ece9eb86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:04.636218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146f2cd-8f3e-4ae0-8e91-9ea4ece9eb86 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:04.647539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 394/809] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Aug 31 00:56:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:04.647539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146f2cd-8f3e-4ae0-8e91-9ea4ece9eb86 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:04.669154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaf663-f221-4df4-9c8c-b340840922f9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:04.707394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516ea29-5749-48a8-8c76-072dd8df9cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:04.708115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516ea29-5749-48a8-8c76-072dd8df9cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:04.708440 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516ea29-5749-48a8-8c76-072dd8df9cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:04.708718 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516ea29-5749-48a8-8c76-072dd8df9cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:04.721613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516ea29-5749-48a8-8c76-072dd8df9cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:04.722990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516ea29-5749-48a8-8c76-072dd8df9cd9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2516ea29-5749-48a8-8c76-072dd8df9cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:04.738336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:04.739319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:04.740230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:04.740230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:04.740230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:04.740230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 416/810] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:04.740230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516ea29-5749-48a8-8c76-072dd8df9cd9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:04.782658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146f2cd-8f3e-4ae0-8e91-9ea4ece9eb86 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:04.818016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f508a9c-a31c-4d1d-b588-153206bc4415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:04.818648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f508a9c-a31c-4d1d-b588-153206bc4415 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:04.818933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f508a9c-a31c-4d1d-b588-153206bc4415 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:04.819220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f508a9c-a31c-4d1d-b588-153206bc4415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:04.831169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f508a9c-a31c-4d1d-b588-153206bc4415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:04.832648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f508a9c-a31c-4d1d-b588-153206bc4415 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:04.839927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2f508a9c-a31c-4d1d-b588-153206bc4415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:04.848073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:04.849043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:04.849943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:04.849943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:04.849943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:04.849943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 395/811] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:04.850576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911616c-2f7f-4b62-b785-9577bdd7402d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:04.850674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911616c-2f7f-4b62-b785-9577bdd7402d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:04.850931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911616c-2f7f-4b62-b785-9577bdd7402d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:04.852268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 396/812] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:04.852836 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911616c-2f7f-4b62-b785-9577bdd7402d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:04.863124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516ea29-5749-48a8-8c76-072dd8df9cd9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:04.865837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:04.900314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b8a6c-c93c-4a94-b134-ed27df0b55bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:04.901425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b8a6c-c93c-4a94-b134-ed27df0b55bd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:04.901831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b8a6c-c93c-4a94-b134-ed27df0b55bd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:04.902119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b8a6c-c93c-4a94-b134-ed27df0b55bd None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:04.902752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b8a6c-c93c-4a94-b134-ed27df0b55bd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:04.903062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b8a6c-c93c-4a94-b134-ed27df0b55bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:04.904563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b8a6c-c93c-4a94-b134-ed27df0b55bd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:04.915142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 417/813] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Aug 31 00:56:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:04.916009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b8a6c-c93c-4a94-b134-ed27df0b55bd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:04.964607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911616c-2f7f-4b62-b785-9577bdd7402d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:05.002566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fb760-552e-4081-a91a-0d38336eaf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:05.003094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fb760-552e-4081-a91a-0d38336eaf82 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.003380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fb760-552e-4081-a91a-0d38336eaf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.003654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fb760-552e-4081-a91a-0d38336eaf82 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.004297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fb760-552e-4081-a91a-0d38336eaf82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:05.004628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fb760-552e-4081-a91a-0d38336eaf82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:05.006265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fb760-552e-4081-a91a-0d38336eaf82 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:05.018330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 397/814] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:05.019537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6961ab-1cc4-44fc-9f8c-af7abc232077 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.019821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6961ab-1cc4-44fc-9f8c-af7abc232077 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.020094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6961ab-1cc4-44fc-9f8c-af7abc232077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.032168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b8a6c-c93c-4a94-b134-ed27df0b55bd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:05.038346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4a6961ab-1cc4-44fc-9f8c-af7abc232077 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:05.039525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4a6961ab-1cc4-44fc-9f8c-af7abc232077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:05.070086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b1d3-509a-4c0b-8ec7-c8de76d23dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:05.070663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b1d3-509a-4c0b-8ec7-c8de76d23dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.070947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b1d3-509a-4c0b-8ec7-c8de76d23dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.071223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b1d3-509a-4c0b-8ec7-c8de76d23dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.071866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b1d3-509a-4c0b-8ec7-c8de76d23dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:05.072200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b1d3-509a-4c0b-8ec7-c8de76d23dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:05.073598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b1d3-509a-4c0b-8ec7-c8de76d23dc8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:05.086529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 418/815] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:05.087346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b1d3-509a-4c0b-8ec7-c8de76d23dc8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:05.105270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:05.117652 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:05.122843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 398/816] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:05.125246 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6961ab-1cc4-44fc-9f8c-af7abc232077 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:05.260008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6961ab-1cc4-44fc-9f8c-af7abc232077 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:05.307833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140e2dd-367f-4f20-9e80-16141c52c219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:05.309481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140e2dd-367f-4f20-9e80-16141c52c219 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.309916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140e2dd-367f-4f20-9e80-16141c52c219 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.310341 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140e2dd-367f-4f20-9e80-16141c52c219 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.320550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140e2dd-367f-4f20-9e80-16141c52c219 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:05.322447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140e2dd-367f-4f20-9e80-16141c52c219 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9140e2dd-367f-4f20-9e80-16141c52c219 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:05.335866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:05.337097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:05.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:05.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:05.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:05.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:05.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:05.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:05.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:05.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:05.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:56:05.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:05.339790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 399/817] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Aug 31 00:56:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:05.340535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140e2dd-367f-4f20-9e80-16141c52c219 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:05.346629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b1d3-509a-4c0b-8ec7-c8de76d23dc8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:05.395188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f83e88-8437-4477-a0c5-22c1bd895b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:05.396013 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f83e88-8437-4477-a0c5-22c1bd895b96 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.396668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f83e88-8437-4477-a0c5-22c1bd895b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.397049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f83e88-8437-4477-a0c5-22c1bd895b96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.398872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f83e88-8437-4477-a0c5-22c1bd895b96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:05.400695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f83e88-8437-4477-a0c5-22c1bd895b96 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:05.412843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:05.436445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 419/818] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 00:56:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:56:05.437704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f83e88-8437-4477-a0c5-22c1bd895b96 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:05.478915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140e2dd-367f-4f20-9e80-16141c52c219 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:05.525821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e3387-3ae1-4149-8765-6889884ad84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:05.526403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e3387-3ae1-4149-8765-6889884ad84f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.526688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e3387-3ae1-4149-8765-6889884ad84f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.526969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e3387-3ae1-4149-8765-6889884ad84f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.535258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e3387-3ae1-4149-8765-6889884ad84f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:05.536887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e3387-3ae1-4149-8765-6889884ad84f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:05.545057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-856e3387-3ae1-4149-8765-6889884ad84f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:05.551738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:05.553640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:05.555638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:05.555638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:05.555638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:05.555638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:05.555638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:05.555638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:05.555638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:05.555638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:05.559324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 400/819] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:05.562584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e3387-3ae1-4149-8765-6889884ad84f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:05.598420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f83e88-8437-4477-a0c5-22c1bd895b96 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:05.643593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa98f38-1b3f-4bd5-8ff8-eb2d27c3489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:05.644215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa98f38-1b3f-4bd5-8ff8-eb2d27c3489b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.644532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa98f38-1b3f-4bd5-8ff8-eb2d27c3489b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.644811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa98f38-1b3f-4bd5-8ff8-eb2d27c3489b None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.645690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa98f38-1b3f-4bd5-8ff8-eb2d27c3489b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:05.646162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa98f38-1b3f-4bd5-8ff8-eb2d27c3489b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:05.648476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa98f38-1b3f-4bd5-8ff8-eb2d27c3489b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:05.669461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 420/820] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Aug 31 00:56:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:05.670315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa98f38-1b3f-4bd5-8ff8-eb2d27c3489b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:05.688308 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e3387-3ae1-4149-8765-6889884ad84f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:05.711343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:05.729665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9af750-8358-4594-86ac-070c87ce069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:05.730300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9af750-8358-4594-86ac-070c87ce069d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.730632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9af750-8358-4594-86ac-070c87ce069d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.730919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9af750-8358-4594-86ac-070c87ce069d None admin] PATH_INFO: `/v3/services/network` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.731650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9af750-8358-4594-86ac-070c87ce069d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:05.733117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9af750-8358-4594-86ac-070c87ce069d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2f9af750-8358-4594-86ac-070c87ce069d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:05.743909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:05.745536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:05.746525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 401/821] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:05 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:05.747421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3827cb-1126-40b2-bdf9-ea145e81aa82 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.747421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3827cb-1126-40b2-bdf9-ea145e81aa82 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.747421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3827cb-1126-40b2-bdf9-ea145e81aa82 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.750025 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 402/822] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:05.751551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3827cb-1126-40b2-bdf9-ea145e81aa82 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:05.796265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa98f38-1b3f-4bd5-8ff8-eb2d27c3489b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:05.822572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:05.831278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4afdd-fd42-4c0b-a06a-5c027b5477f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:05.831887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4afdd-fd42-4c0b-a06a-5c027b5477f2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.832164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4afdd-fd42-4c0b-a06a-5c027b5477f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.832473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4afdd-fd42-4c0b-a06a-5c027b5477f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.833165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4afdd-fd42-4c0b-a06a-5c027b5477f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:05.833470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4afdd-fd42-4c0b-a06a-5c027b5477f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:05.834894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4afdd-fd42-4c0b-a06a-5c027b5477f2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:05.848991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 421/823] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:05.849832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4afdd-fd42-4c0b-a06a-5c027b5477f2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:05.884340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3827cb-1126-40b2-bdf9-ea145e81aa82 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:05.924189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4fcf1-6b0d-44ef-8abe-cee0c67ad96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:05.924842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4fcf1-6b0d-44ef-8abe-cee0c67ad96d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:05.925127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4fcf1-6b0d-44ef-8abe-cee0c67ad96d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:05.925408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4fcf1-6b0d-44ef-8abe-cee0c67ad96d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:05.963913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4afdd-fd42-4c0b-a06a-5c027b5477f2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:05.985152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:06.007726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcba19-9932-45f9-b2eb-f42cfa92f327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:06.008466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcba19-9932-45f9-b2eb-f42cfa92f327 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:06.008740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcba19-9932-45f9-b2eb-f42cfa92f327 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:06.009009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcba19-9932-45f9-b2eb-f42cfa92f327 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:06.009631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcba19-9932-45f9-b2eb-f42cfa92f327 None admin] RBAC: Adding query filter params (name=network) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:06.009866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4fcf1-6b0d-44ef-8abe-cee0c67ad96d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:06.009986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcba19-9932-45f9-b2eb-f42cfa92f327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:06.011272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcba19-9932-45f9-b2eb-f42cfa92f327 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:06.011725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4fcf1-6b0d-44ef-8abe-cee0c67ad96d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:06.016391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 422/824] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:06.017597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bacf4-40f3-4c6c-8808-9c172cd61752 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:06.017883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bacf4-40f3-4c6c-8808-9c172cd61752 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:06.018156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bacf4-40f3-4c6c-8808-9c172cd61752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:06.038317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e35bacf4-40f3-4c6c-8808-9c172cd61752 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:06.039658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e35bacf4-40f3-4c6c-8808-9c172cd61752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:06.089026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:06.110284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 423/825] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:06.111600 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bacf4-40f3-4c6c-8808-9c172cd61752 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:06.183853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 403/826] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:56:06.185741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4fcf1-6b0d-44ef-8abe-cee0c67ad96d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:06.284284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bacf4-40f3-4c6c-8808-9c172cd61752 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:06.332503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:06.343833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56311a5-9939-469e-af50-3bc1be5b1c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:06.344851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56311a5-9939-469e-af50-3bc1be5b1c2d None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:06.345341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56311a5-9939-469e-af50-3bc1be5b1c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:06.345815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56311a5-9939-469e-af50-3bc1be5b1c2d None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/814473b735314e4cb2321e952777031c/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:06.347966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56311a5-9939-469e-af50-3bc1be5b1c2d None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=814473b735314e4cb2321e952777031c, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:06.349639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56311a5-9939-469e-af50-3bc1be5b1c2d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:06.360645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4fcf1-6b0d-44ef-8abe-cee0c67ad96d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:06.367987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 424/827] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:56:06 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/814473b735314e4cb2321e952777031c/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:56:06.369672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56311a5-9939-469e-af50-3bc1be5b1c2d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:06.426366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:06.432179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee364ab-35b9-4e14-b180-a3d2ef792a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:06.432892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee364ab-35b9-4e14-b180-a3d2ef792a2d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:06.433183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee364ab-35b9-4e14-b180-a3d2ef792a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:06.433462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee364ab-35b9-4e14-b180-a3d2ef792a2d None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:06.434135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee364ab-35b9-4e14-b180-a3d2ef792a2d None admin] RBAC: Adding query filter params (type=network) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:06.434490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee364ab-35b9-4e14-b180-a3d2ef792a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:06.435981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee364ab-35b9-4e14-b180-a3d2ef792a2d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:06.449495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 404/828] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:06.458126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee364ab-35b9-4e14-b180-a3d2ef792a2d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:06.502136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56311a5-9939-469e-af50-3bc1be5b1c2d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:06.545451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4aae3-d5f7-4f0a-9dc5-d4a8f03e90de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:06.546469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4aae3-d5f7-4f0a-9dc5-d4a8f03e90de None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:06.546975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4aae3-d5f7-4f0a-9dc5-d4a8f03e90de None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:06.547461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4aae3-d5f7-4f0a-9dc5-d4a8f03e90de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:06.559871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4aae3-d5f7-4f0a-9dc5-d4a8f03e90de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:06.561743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4aae3-d5f7-4f0a-9dc5-d4a8f03e90de None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9fe4aae3-d5f7-4f0a-9dc5-d4a8f03e90de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:06.579316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:06.580352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:06.581244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:06.581244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:06.581244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:06.583475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 425/829] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:06.594831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4aae3-d5f7-4f0a-9dc5-d4a8f03e90de None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:06.671395 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee364ab-35b9-4e14-b180-a3d2ef792a2d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:06.721428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a803df-2b17-42bf-9082-1fa8df8f6489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:06.722046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a803df-2b17-42bf-9082-1fa8df8f6489 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:06.722569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a803df-2b17-42bf-9082-1fa8df8f6489 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:06.722864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a803df-2b17-42bf-9082-1fa8df8f6489 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:06.723547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a803df-2b17-42bf-9082-1fa8df8f6489 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:06.725447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a803df-2b17-42bf-9082-1fa8df8f6489 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:06.731986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:06.743035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4aae3-d5f7-4f0a-9dc5-d4a8f03e90de None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:06.756335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:06.757732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 405/830] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 00:56:06 2022] POST /identity/v3/endpoints => generated 337 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:56:06.758858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a803df-2b17-42bf-9082-1fa8df8f6489 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:06.813177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19b202-58a5-4683-a383-be932662cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:06.814137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19b202-58a5-4683-a383-be932662cac1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:06.814642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19b202-58a5-4683-a383-be932662cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:06.815060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19b202-58a5-4683-a383-be932662cac1 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:06.815872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19b202-58a5-4683-a383-be932662cac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:06.816448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19b202-58a5-4683-a383-be932662cac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:06.818122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19b202-58a5-4683-a383-be932662cac1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:06.834755 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 426/831] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:06.844281 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19b202-58a5-4683-a383-be932662cac1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:06.953901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a803df-2b17-42bf-9082-1fa8df8f6489 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:06.994227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc3e66-011e-495b-81e9-75a88c7d0f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:06.995232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc3e66-011e-495b-81e9-75a88c7d0f23 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:06.995758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc3e66-011e-495b-81e9-75a88c7d0f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:06.996182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc3e66-011e-495b-81e9-75a88c7d0f23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.008843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc3e66-011e-495b-81e9-75a88c7d0f23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-14fc3e66-011e-495b-81e9-75a88c7d0f23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:07.014416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:07.015546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:56:07.016625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:07.018913 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 406/832] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:56:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:07.025075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc3e66-011e-495b-81e9-75a88c7d0f23 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:07.071766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19b202-58a5-4683-a383-be932662cac1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:07.092772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:07.117483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef7175-00f5-441b-b0ed-275523596fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:07.118241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef7175-00f5-441b-b0ed-275523596fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:07.118617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef7175-00f5-441b-b0ed-275523596fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:07.118895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef7175-00f5-441b-b0ed-275523596fa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.127903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef7175-00f5-441b-b0ed-275523596fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:07.129564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef7175-00f5-441b-b0ed-275523596fa5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-53ef7175-00f5-441b-b0ed-275523596fa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:07.145585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:07.146713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:07.148003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:07.148003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:07.148003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:07.148003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:07.148003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:07.148003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:07.148003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:07.148003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:07.148003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 427/833] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:07.153208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef7175-00f5-441b-b0ed-275523596fa5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:07.155018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc3e66-011e-495b-81e9-75a88c7d0f23 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:07.172020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:07.194382 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6531d2a-8bb1-4268-9c44-f8287a242e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:07.195289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531d2a-8bb1-4268-9c44-f8287a242e38 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:07.195711 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531d2a-8bb1-4268-9c44-f8287a242e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:07.196136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531d2a-8bb1-4268-9c44-f8287a242e38 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.196986 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6531d2a-8bb1-4268-9c44-f8287a242e38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:07.197439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6531d2a-8bb1-4268-9c44-f8287a242e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:07.198976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6531d2a-8bb1-4268-9c44-f8287a242e38 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:07.209261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 407/834] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:56:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:07.215393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6531d2a-8bb1-4268-9c44-f8287a242e38 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:07.295415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef7175-00f5-441b-b0ed-275523596fa5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:07.324081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6531d2a-8bb1-4268-9c44-f8287a242e38 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:07.335867 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bf1b1-b176-4c3c-90da-00a3b1ed2ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:07.336663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bf1b1-b176-4c3c-90da-00a3b1ed2ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:07.337269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bf1b1-b176-4c3c-90da-00a3b1ed2ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:07.337538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bf1b1-b176-4c3c-90da-00a3b1ed2ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.338351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bf1b1-b176-4c3c-90da-00a3b1ed2ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:07.338739 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bf1b1-b176-4c3c-90da-00a3b1ed2ee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:07.340402 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bf1b1-b176-4c3c-90da-00a3b1ed2ee2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:07.351605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:07.357056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 428/835] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:07.362407 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bf1b1-b176-4c3c-90da-00a3b1ed2ee2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:07.370355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c21a64-36ea-43ab-b43f-faecd3ea64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:07.371279 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c21a64-36ea-43ab-b43f-faecd3ea64ad None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:07.371784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c21a64-36ea-43ab-b43f-faecd3ea64ad None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:07.372259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c21a64-36ea-43ab-b43f-faecd3ea64ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.384179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c21a64-36ea-43ab-b43f-faecd3ea64ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:07.386097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c21a64-36ea-43ab-b43f-faecd3ea64ad None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-80c21a64-36ea-43ab-b43f-faecd3ea64ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:07.402033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:07.403085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:07.404113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:07.404113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:07.404113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:07.411288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 408/836] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:07.412521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c21a64-36ea-43ab-b43f-faecd3ea64ad None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:07.450101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:07.495794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bf1b1-b176-4c3c-90da-00a3b1ed2ee2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:07.535065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c21a64-36ea-43ab-b43f-faecd3ea64ad None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:07.541339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8dbad-9d40-485c-ac78-6b873341b50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:07.541963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8dbad-9d40-485c-ac78-6b873341b50e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:07.542247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8dbad-9d40-485c-ac78-6b873341b50e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:07.542527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8dbad-9d40-485c-ac78-6b873341b50e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.543267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8dbad-9d40-485c-ac78-6b873341b50e None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=a99d74d9d72c4fc2a363ce6559e4ddff) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:07.543581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8dbad-9d40-485c-ac78-6b873341b50e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:07.545055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8dbad-9d40-485c-ac78-6b873341b50e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:07.556307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 429/837] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:07 2022] GET /identity/v3/role_assignments?user.id=a99d74d9d72c4fc2a363ce6559e4ddff&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:07.581900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de9a8d-6b7e-4190-9b42-b4e9b2ebf2ae None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:07.582246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de9a8d-6b7e-4190-9b42-b4e9b2ebf2ae None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:07.582445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de9a8d-6b7e-4190-9b42-b4e9b2ebf2ae None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.584144 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 430/838] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:56:07.590615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6f97-d8f4-4542-bacf-9063fbd12810 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:07.591002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6f97-d8f4-4542-bacf-9063fbd12810 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:07.591482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6f97-d8f4-4542-bacf-9063fbd12810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.592471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e2ed8-4a43-4e0d-9f9d-c6414c851811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:07.593449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e2ed8-4a43-4e0d-9f9d-c6414c851811 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:07.593978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e2ed8-4a43-4e0d-9f9d-c6414c851811 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:07.594596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e2ed8-4a43-4e0d-9f9d-c6414c851811 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.595669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e2ed8-4a43-4e0d-9f9d-c6414c851811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:07.596172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e2ed8-4a43-4e0d-9f9d-c6414c851811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:07.597965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e2ed8-4a43-4e0d-9f9d-c6414c851811 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:07.613466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 409/839] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:07.618201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-afeb6f97-d8f4-4542-bacf-9063fbd12810 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:07.618201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-afeb6f97-d8f4-4542-bacf-9063fbd12810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:07.620671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e2ed8-4a43-4e0d-9f9d-c6414c851811 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:07.674363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:07.728390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 431/840] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:07.769331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e2ed8-4a43-4e0d-9f9d-c6414c851811 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:07.809619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591edd6b-98ee-4b23-a2cc-0d0ace6eabd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:07.810301 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591edd6b-98ee-4b23-a2cc-0d0ace6eabd6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:07.810664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591edd6b-98ee-4b23-a2cc-0d0ace6eabd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:07.810949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591edd6b-98ee-4b23-a2cc-0d0ace6eabd6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.819267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591edd6b-98ee-4b23-a2cc-0d0ace6eabd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:07.821081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591edd6b-98ee-4b23-a2cc-0d0ace6eabd6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-591edd6b-98ee-4b23-a2cc-0d0ace6eabd6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:07.833511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:07.834480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:07.837029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 410/841] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Aug 31 00:56:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:07.841505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb6f97-d8f4-4542-bacf-9063fbd12810 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:07.913233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:07.957434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb6f97-d8f4-4542-bacf-9063fbd12810 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:07.994380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cabeb8-2f59-487c-83de-a4738cf7fccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:07.995003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cabeb8-2f59-487c-83de-a4738cf7fccb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:07.995289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cabeb8-2f59-487c-83de-a4738cf7fccb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:07.995567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cabeb8-2f59-487c-83de-a4738cf7fccb None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:07.996308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cabeb8-2f59-487c-83de-a4738cf7fccb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:07.996647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cabeb8-2f59-487c-83de-a4738cf7fccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:07.998092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cabeb8-2f59-487c-83de-a4738cf7fccb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:08.012631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591edd6b-98ee-4b23-a2cc-0d0ace6eabd6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:08.017934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 432/842] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Aug 31 00:56:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:08.026111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cabeb8-2f59-487c-83de-a4738cf7fccb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:08.132718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:08.140984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591edd6b-98ee-4b23-a2cc-0d0ace6eabd6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:08.150614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cabeb8-2f59-487c-83de-a4738cf7fccb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:08.174241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:08.188234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed51436-06bc-4904-b6d1-b95b8f8ca1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:08.189612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51436-06bc-4904-b6d1-b95b8f8ca1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:08.190210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51436-06bc-4904-b6d1-b95b8f8ca1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:08.190890 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51436-06bc-4904-b6d1-b95b8f8ca1a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:08.191797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed51436-06bc-4904-b6d1-b95b8f8ca1a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:08.191995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339b6d6-3a65-4c3e-9461-547be27a54a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:08.192639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339b6d6-3a65-4c3e-9461-547be27a54a6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:08.192928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339b6d6-3a65-4c3e-9461-547be27a54a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:08.193207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339b6d6-3a65-4c3e-9461-547be27a54a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:08.194502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed51436-06bc-4904-b6d1-b95b8f8ca1a1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9ed51436-06bc-4904-b6d1-b95b8f8ca1a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:08.204435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:08.205488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:56:08.206309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:08.209152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 411/843] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:56:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:08.215517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed51436-06bc-4904-b6d1-b95b8f8ca1a1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:08.267723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339b6d6-3a65-4c3e-9461-547be27a54a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:08.269225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339b6d6-3a65-4c3e-9461-547be27a54a6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:08.336132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed51436-06bc-4904-b6d1-b95b8f8ca1a1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:08.376726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 433/844] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:08 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:56:08.378768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30081-7522-48bb-9b0f-b172ad9036b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:08.379254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30081-7522-48bb-9b0f-b172ad9036b5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:08.379254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30081-7522-48bb-9b0f-b172ad9036b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:08.379615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30081-7522-48bb-9b0f-b172ad9036b5 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:08.380259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30081-7522-48bb-9b0f-b172ad9036b5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:08.380775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30081-7522-48bb-9b0f-b172ad9036b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:08.382307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339b6d6-3a65-4c3e-9461-547be27a54a6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:08.382426 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30081-7522-48bb-9b0f-b172ad9036b5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:08.392657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 412/845] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:56:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:08.394044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30081-7522-48bb-9b0f-b172ad9036b5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:08.406168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:08.424679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:08.496157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339b6d6-3a65-4c3e-9461-547be27a54a6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:08.513037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30081-7522-48bb-9b0f-b172ad9036b5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:08.534747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6327d-452a-4ec2-842e-33722de7d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:08.535593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6327d-452a-4ec2-842e-33722de7d24f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:08.536214 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6327d-452a-4ec2-842e-33722de7d24f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:08.536462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6327d-452a-4ec2-842e-33722de7d24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:08.548590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6327d-452a-4ec2-842e-33722de7d24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:08.550636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6327d-452a-4ec2-842e-33722de7d24f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:08.552032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080c311-5f32-4978-941a-6ddc9a21fc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:08.553021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080c311-5f32-4978-941a-6ddc9a21fc2a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:08.554124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080c311-5f32-4978-941a-6ddc9a21fc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:08.554864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080c311-5f32-4978-941a-6ddc9a21fc2a None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:08.555818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080c311-5f32-4978-941a-6ddc9a21fc2a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:08.556367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080c311-5f32-4978-941a-6ddc9a21fc2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:08.557946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080c311-5f32-4978-941a-6ddc9a21fc2a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d9c6327d-452a-4ec2-842e-33722de7d24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:08.567876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:08.568942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:08.570987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:08.570987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:08.570987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:08.570987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 434/846] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:08.571848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 413/847] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:56:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:08.574719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6327d-452a-4ec2-842e-33722de7d24f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:08.664948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:08.677128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2061ce-1d2a-4083-8fb8-44ee2b7b8fd8 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:08.677457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2061ce-1d2a-4083-8fb8-44ee2b7b8fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:08.677706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2061ce-1d2a-4083-8fb8-44ee2b7b8fd8 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:08.680024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 414/848] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:08.688625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ba6dd-77a9-4b5d-93a0-48479b9ac8f9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:08.689267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ba6dd-77a9-4b5d-93a0-48479b9ac8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:08.689800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ba6dd-77a9-4b5d-93a0-48479b9ac8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:08.711391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6327d-452a-4ec2-842e-33722de7d24f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:08.715952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7c4ba6dd-77a9-4b5d-93a0-48479b9ac8f9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:08.717850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7c4ba6dd-77a9-4b5d-93a0-48479b9ac8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:08.759705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d583-dfd6-4679-a6b3-bfda9920c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:08.760501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d583-dfd6-4679-a6b3-bfda9920c9ce None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:08.760875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d583-dfd6-4679-a6b3-bfda9920c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:08.761233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d583-dfd6-4679-a6b3-bfda9920c9ce None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:08.761980 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6d583-dfd6-4679-a6b3-bfda9920c9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:08.762361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6d583-dfd6-4679-a6b3-bfda9920c9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:08.763830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6d583-dfd6-4679-a6b3-bfda9920c9ce None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:08.777411 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 435/849] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:08.785640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d583-dfd6-4679-a6b3-bfda9920c9ce None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:08.807699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 415/850] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:08.902828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d583-dfd6-4679-a6b3-bfda9920c9ce None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:08.936615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:08.942615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5aa31-575d-439e-8162-9b54aae40316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:08.943348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5aa31-575d-439e-8162-9b54aae40316 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:08.943631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5aa31-575d-439e-8162-9b54aae40316 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:08.943961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5aa31-575d-439e-8162-9b54aae40316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:08.952738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5aa31-575d-439e-8162-9b54aae40316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:08.954725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5aa31-575d-439e-8162-9b54aae40316 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6ed5aa31-575d-439e-8162-9b54aae40316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:08.969284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:08.970384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:08.971565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:08.971565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:08.971565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:08.971565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:08.971565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:08.971565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:08.971565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:08.971565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:08.971565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 436/851] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:08.977417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ba6dd-77a9-4b5d-93a0-48479b9ac8f9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:08.996502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:09.083523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5aa31-575d-439e-8162-9b54aae40316 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:09.103526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ba6dd-77a9-4b5d-93a0-48479b9ac8f9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:09.149236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d0e2b-239c-43df-885c-318538ecd802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:09.150325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d0e2b-239c-43df-885c-318538ecd802 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:09.150325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d0e2b-239c-43df-885c-318538ecd802 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:09.150492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d0e2b-239c-43df-885c-318538ecd802 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:09.151075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d0e2b-239c-43df-885c-318538ecd802 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:09.151382 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d0e2b-239c-43df-885c-318538ecd802 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:09.153132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d0e2b-239c-43df-885c-318538ecd802 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:09.168894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 416/852] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:09.177643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d0e2b-239c-43df-885c-318538ecd802 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:09.208540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5aa31-575d-439e-8162-9b54aae40316 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:09.258284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51e2f-6b61-4d5f-9e23-d41d98ef904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:09.259378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51e2f-6b61-4d5f-9e23-d41d98ef904e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:09.259903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51e2f-6b61-4d5f-9e23-d41d98ef904e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:09.260460 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51e2f-6b61-4d5f-9e23-d41d98ef904e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:09.274108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51e2f-6b61-4d5f-9e23-d41d98ef904e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:09.279570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-10a51e2f-6b61-4d5f-9e23-d41d98ef904e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:09.281307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:09.283155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:09.284552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:09.291649 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 437/853] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:56:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:09.292909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51e2f-6b61-4d5f-9e23-d41d98ef904e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:09.310901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d0e2b-239c-43df-885c-318538ecd802 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:09.358938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:09.362209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4bccd-bade-422b-956f-6f095354a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:09.362830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4bccd-bade-422b-956f-6f095354a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:09.363116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4bccd-bade-422b-956f-6f095354a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:09.363394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4bccd-bade-422b-956f-6f095354a2a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:09.364391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4bccd-bade-422b-956f-6f095354a2a5 None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=4f7bdd26be524f6e8354e6fbdcd50136) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:09.364999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4bccd-bade-422b-956f-6f095354a2a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:09.368203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4bccd-bade-422b-956f-6f095354a2a5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:09.377119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 417/854] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:09 2022] GET /identity/v3/role_assignments?user.id=4f7bdd26be524f6e8354e6fbdcd50136&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:09.422531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51e2f-6b61-4d5f-9e23-d41d98ef904e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:09.463970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ac85e-84f9-4fe5-8c0e-c41351c5808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:09.464555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ac85e-84f9-4fe5-8c0e-c41351c5808f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:09.464835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ac85e-84f9-4fe5-8c0e-c41351c5808f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:09.465109 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ac85e-84f9-4fe5-8c0e-c41351c5808f None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:09.465796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ac85e-84f9-4fe5-8c0e-c41351c5808f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:09.466364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ac85e-84f9-4fe5-8c0e-c41351c5808f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:09.467765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ac85e-84f9-4fe5-8c0e-c41351c5808f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:09.478160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 438/855] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:56:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:09.484045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4bccd-bade-422b-956f-6f095354a2a5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:09.606665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4bccd-bade-422b-956f-6f095354a2a5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:09.645945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4cb9b-a9d9-4555-bff6-b7bef3cb0500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:09.646650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4cb9b-a9d9-4555-bff6-b7bef3cb0500 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:09.646953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4cb9b-a9d9-4555-bff6-b7bef3cb0500 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:09.647296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4cb9b-a9d9-4555-bff6-b7bef3cb0500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:09.659017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:09.662253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4cb9b-a9d9-4555-bff6-b7bef3cb0500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:09.664557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4cb9b-a9d9-4555-bff6-b7bef3cb0500 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d4f4cb9b-a9d9-4555-bff6-b7bef3cb0500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:09.683086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:09.684290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:09.685494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:09.685494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:09.685494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:09.686065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 418/856] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:09.692017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ac85e-84f9-4fe5-8c0e-c41351c5808f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:09.727106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd310e6d-1511-41ca-a281-773b9cbee5fa None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:09.727399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd310e6d-1511-41ca-a281-773b9cbee5fa None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:09.727766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd310e6d-1511-41ca-a281-773b9cbee5fa None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:09.729511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 419/857] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:09.736693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e51d75-35ae-4b9a-91cd-bb38c1a2aa19 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:09.737169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e51d75-35ae-4b9a-91cd-bb38c1a2aa19 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:09.737601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e51d75-35ae-4b9a-91cd-bb38c1a2aa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:09.763591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-33e51d75-35ae-4b9a-91cd-bb38c1a2aa19 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:09.765248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-33e51d75-35ae-4b9a-91cd-bb38c1a2aa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:09.823873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ac85e-84f9-4fe5-8c0e-c41351c5808f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:09.843610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:09.868411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 420/858] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:09.878281 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fc7da-8a4a-4f53-bd3b-701df91c74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:09.879132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc7da-8a4a-4f53-bd3b-701df91c74e6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:09.879599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc7da-8a4a-4f53-bd3b-701df91c74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:09.880093 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc7da-8a4a-4f53-bd3b-701df91c74e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:09.881029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fc7da-8a4a-4f53-bd3b-701df91c74e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:09.881518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fc7da-8a4a-4f53-bd3b-701df91c74e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:09.883939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fc7da-8a4a-4f53-bd3b-701df91c74e6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:09.898002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 439/859] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:09.903866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e51d75-35ae-4b9a-91cd-bb38c1a2aa19 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:10.013419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e51d75-35ae-4b9a-91cd-bb38c1a2aa19 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:10.037215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:10.050519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcbd7d-504b-4e1e-9d80-143852b6df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:10.051427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcbd7d-504b-4e1e-9d80-143852b6df59 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:10.051898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcbd7d-504b-4e1e-9d80-143852b6df59 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:10.052383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcbd7d-504b-4e1e-9d80-143852b6df59 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:10.061113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcbd7d-504b-4e1e-9d80-143852b6df59 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:10.062808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcbd7d-504b-4e1e-9d80-143852b6df59 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9adcbd7d-504b-4e1e-9d80-143852b6df59 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:10.075530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:10.076584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:10.077535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:10.077535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:10.077535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:10.077535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:10.077535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:10.077535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:10.077535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:10.077535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:10.077535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:56:10.077535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:10.079673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 421/860] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:56:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:10.086103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fc7da-8a4a-4f53-bd3b-701df91c74e6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:10.168505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcbd7d-504b-4e1e-9d80-143852b6df59 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:10.210683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fc7da-8a4a-4f53-bd3b-701df91c74e6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:10.250309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeaa28b-931b-494e-925c-34ae0a7da071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:10.250944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa28b-931b-494e-925c-34ae0a7da071 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:10.251234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa28b-931b-494e-925c-34ae0a7da071 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:10.251517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa28b-931b-494e-925c-34ae0a7da071 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:10.252271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaa28b-931b-494e-925c-34ae0a7da071 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:10.252821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaa28b-931b-494e-925c-34ae0a7da071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:10.254033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaa28b-931b-494e-925c-34ae0a7da071 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:10.279863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 440/861] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Aug 31 00:56:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:10.280936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeaa28b-931b-494e-925c-34ae0a7da071 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:10.314368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcbd7d-504b-4e1e-9d80-143852b6df59 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:10.315167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:10.368234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb826af7-9dfd-437e-81ce-71203e718795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:10.369202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826af7-9dfd-437e-81ce-71203e718795 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:10.370108 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826af7-9dfd-437e-81ce-71203e718795 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:10.370540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826af7-9dfd-437e-81ce-71203e718795 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:10.371693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb826af7-9dfd-437e-81ce-71203e718795 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:10.373656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb826af7-9dfd-437e-81ce-71203e718795 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-fb826af7-9dfd-437e-81ce-71203e718795 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:10.387645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:10.388882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:56:10.389995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:10.398087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 422/862] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Aug 31 00:56:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:10.399452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb826af7-9dfd-437e-81ce-71203e718795 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:10.404684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeaa28b-931b-494e-925c-34ae0a7da071 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:10.443054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5e580-e458-4096-b815-1ec996aa4e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:10.443865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5e580-e458-4096-b815-1ec996aa4e5d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:10.444861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5e580-e458-4096-b815-1ec996aa4e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:10.445247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5e580-e458-4096-b815-1ec996aa4e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:10.467201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:10.526500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5e580-e458-4096-b815-1ec996aa4e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:10.528145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5e580-e458-4096-b815-1ec996aa4e5d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:10.547041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb826af7-9dfd-437e-81ce-71203e718795 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:10.562845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:10.601988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740d537-ed5a-4de6-805d-ad54ae56446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:10.603517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740d537-ed5a-4de6-805d-ad54ae56446c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:10.603960 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740d537-ed5a-4de6-805d-ad54ae56446c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:10.604543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740d537-ed5a-4de6-805d-ad54ae56446c None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:10.605462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740d537-ed5a-4de6-805d-ad54ae56446c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:10.606204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740d537-ed5a-4de6-805d-ad54ae56446c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:10.609347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740d537-ed5a-4de6-805d-ad54ae56446c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:10.620527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 423/863] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:10.622915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740d537-ed5a-4de6-805d-ad54ae56446c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:10.656190 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 441/864] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:56:10.662603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5e580-e458-4096-b815-1ec996aa4e5d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:10.748504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740d537-ed5a-4de6-805d-ad54ae56446c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:10.760567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:10.781991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5e580-e458-4096-b815-1ec996aa4e5d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:10.787466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44ecbd-e7fe-4d97-80f1-ff5af2dce689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:10.788366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ecbd-e7fe-4d97-80f1-ff5af2dce689 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:10.788668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ecbd-e7fe-4d97-80f1-ff5af2dce689 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:10.789046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ecbd-e7fe-4d97-80f1-ff5af2dce689 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:10.789710 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44ecbd-e7fe-4d97-80f1-ff5af2dce689 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:10.790020 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44ecbd-e7fe-4d97-80f1-ff5af2dce689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:10.791381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44ecbd-e7fe-4d97-80f1-ff5af2dce689 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:10.795927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 424/865] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:10.797182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86ba60-05d4-441a-a650-5860030e0dac None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:10.797413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86ba60-05d4-441a-a650-5860030e0dac None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:10.797670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86ba60-05d4-441a-a650-5860030e0dac None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:10.799156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 425/866] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:10.805741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea4140-57df-46e5-9b25-303ba4a04e56 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:10.805959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea4140-57df-46e5-9b25-303ba4a04e56 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:10.806205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea4140-57df-46e5-9b25-303ba4a04e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:10.824719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:10.827192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0dea4140-57df-46e5-9b25-303ba4a04e56 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:10.828576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0dea4140-57df-46e5-9b25-303ba4a04e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:10.829785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5b1ad-f7af-40f0-8dad-00ece7aa2721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:10.830897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5b1ad-f7af-40f0-8dad-00ece7aa2721 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:10.831374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5b1ad-f7af-40f0-8dad-00ece7aa2721 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:10.832616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5b1ad-f7af-40f0-8dad-00ece7aa2721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:10.845073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5b1ad-f7af-40f0-8dad-00ece7aa2721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:10.846786 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5b1ad-f7af-40f0-8dad-00ece7aa2721 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8fa5b1ad-f7af-40f0-8dad-00ece7aa2721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:10.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:10.866847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:10.867723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:10.867723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:10.867723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:10.872211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 442/867] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:10.873262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5b1ad-f7af-40f0-8dad-00ece7aa2721 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:10.916817 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 426/868] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:10.990691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5b1ad-f7af-40f0-8dad-00ece7aa2721 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:11.027556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab647556-28fd-40c6-ba4b-692c4ecfa86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:11.028273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab647556-28fd-40c6-ba4b-692c4ecfa86d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:11.028997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab647556-28fd-40c6-ba4b-692c4ecfa86d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:11.029343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab647556-28fd-40c6-ba4b-692c4ecfa86d None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:11.030067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab647556-28fd-40c6-ba4b-692c4ecfa86d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:11.030446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab647556-28fd-40c6-ba4b-692c4ecfa86d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:11.031890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab647556-28fd-40c6-ba4b-692c4ecfa86d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:11.045199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 443/869] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:11.050915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea4140-57df-46e5-9b25-303ba4a04e56 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:11.165750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea4140-57df-46e5-9b25-303ba4a04e56 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:11.168359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:11.204103 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bb10f-4044-40b9-b2b6-9292da89aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:11.204781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bb10f-4044-40b9-b2b6-9292da89aa19 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:11.205064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bb10f-4044-40b9-b2b6-9292da89aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:11.205339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bb10f-4044-40b9-b2b6-9292da89aa19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:11.209520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab647556-28fd-40c6-ba4b-692c4ecfa86d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:11.213596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bb10f-4044-40b9-b2b6-9292da89aa19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:11.215140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bb10f-4044-40b9-b2b6-9292da89aa19 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e27bb10f-4044-40b9-b2b6-9292da89aa19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:11.228403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:11.229827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:11.230745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:11.230745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:11.230745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:11.230745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:11.230745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:11.230745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:11.230745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:11.230745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:11.230745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 427/870] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:11.235439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bb10f-4044-40b9-b2b6-9292da89aa19 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:11.276752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:11.344216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab647556-28fd-40c6-ba4b-692c4ecfa86d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:11.369100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bb10f-4044-40b9-b2b6-9292da89aa19 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:11.382802 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c416e-97fe-4931-913d-9913eb6bd27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:11.383528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c416e-97fe-4931-913d-9913eb6bd27d None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:11.384270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c416e-97fe-4931-913d-9913eb6bd27d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:11.384270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c416e-97fe-4931-913d-9913eb6bd27d None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:11.384866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c416e-97fe-4931-913d-9913eb6bd27d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:11.386242 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c416e-97fe-4931-913d-9913eb6bd27d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:11.405865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 444/871] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:56:11 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:56:11.418864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6d509-19cf-483e-9894-482599f63fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:11.419559 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d509-19cf-483e-9894-482599f63fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:11.419897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d509-19cf-483e-9894-482599f63fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:11.420181 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d509-19cf-483e-9894-482599f63fb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:11.420949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6d509-19cf-483e-9894-482599f63fb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:11.421259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6d509-19cf-483e-9894-482599f63fb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:11.422836 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6d509-19cf-483e-9894-482599f63fb0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:11.438850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 428/872] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:11.445036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c416e-97fe-4931-913d-9913eb6bd27d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:11.558555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a99572-ccce-40da-9aff-ad6ae581d880 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:11.559118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a99572-ccce-40da-9aff-ad6ae581d880 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:11.559118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a99572-ccce-40da-9aff-ad6ae581d880 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:11.560639 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 429/873] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:11.567030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b307-2fe8-4d25-8c50-330d50341e1a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:11.567590 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b307-2fe8-4d25-8c50-330d50341e1a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:11.567874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b307-2fe8-4d25-8c50-330d50341e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:11.572314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c416e-97fe-4931-913d-9913eb6bd27d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:11.575258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:11.592444 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1e34b307-2fe8-4d25-8c50-330d50341e1a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:11.593794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1e34b307-2fe8-4d25-8c50-330d50341e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:11.614438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:11.623509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e59bc-12e3-46bc-87b0-1f1d64ff7d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:11.624130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e59bc-12e3-46bc-87b0-1f1d64ff7d6d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:11.624698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e59bc-12e3-46bc-87b0-1f1d64ff7d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:11.624698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e59bc-12e3-46bc-87b0-1f1d64ff7d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:11.625428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e59bc-12e3-46bc-87b0-1f1d64ff7d6d None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=814473b735314e4cb2321e952777031c) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:11.625734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e59bc-12e3-46bc-87b0-1f1d64ff7d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:11.627173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e59bc-12e3-46bc-87b0-1f1d64ff7d6d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:11.636394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 445/874] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:11 2022] GET /identity/v3/role_assignments?user.id=814473b735314e4cb2321e952777031c&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:11.692412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 430/875] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:11 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:11.987210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e59bc-12e3-46bc-87b0-1f1d64ff7d6d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:12.113061 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e59bc-12e3-46bc-87b0-1f1d64ff7d6d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:12.155885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed8e71-0893-480f-b061-51e708fb973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:12.156857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed8e71-0893-480f-b061-51e708fb973b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:12.157357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed8e71-0893-480f-b061-51e708fb973b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:12.157849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed8e71-0893-480f-b061-51e708fb973b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:12.169454 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed8e71-0893-480f-b061-51e708fb973b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-68ed8e71-0893-480f-b061-51e708fb973b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:12.175022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:12.176006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:12.177233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:12.180578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 446/876] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Aug 31 00:56:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:12.191019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34b307-2fe8-4d25-8c50-330d50341e1a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:12.300139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34b307-2fe8-4d25-8c50-330d50341e1a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:12.338009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef380a-1035-4471-b36d-3f9abd287548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:12.338622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef380a-1035-4471-b36d-3f9abd287548 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:12.338904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef380a-1035-4471-b36d-3f9abd287548 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:12.339177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef380a-1035-4471-b36d-3f9abd287548 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:12.339842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef380a-1035-4471-b36d-3f9abd287548 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:12.340145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef380a-1035-4471-b36d-3f9abd287548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:12.341819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef380a-1035-4471-b36d-3f9abd287548 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:12.350636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 431/877] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Aug 31 00:56:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:12.359379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed8e71-0893-480f-b061-51e708fb973b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:12.401204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:12.476198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed8e71-0893-480f-b061-51e708fb973b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:12.511671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187b30b-9e74-46b0-a7c7-c933352b756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:12.512305 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187b30b-9e74-46b0-a7c7-c933352b756a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:12.512610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187b30b-9e74-46b0-a7c7-c933352b756a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:12.512884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187b30b-9e74-46b0-a7c7-c933352b756a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:12.524189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187b30b-9e74-46b0-a7c7-c933352b756a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:12.525681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187b30b-9e74-46b0-a7c7-c933352b756a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5187b30b-9e74-46b0-a7c7-c933352b756a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:12.541073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:12.542117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:12.543021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:12.543021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:12.543021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:12.543021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 447/878] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:12.549450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef380a-1035-4471-b36d-3f9abd287548 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:12.565638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:12.701743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef380a-1035-4471-b36d-3f9abd287548 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:12.760892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf376f-7968-468f-aade-9c56e34ddf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:12.761909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf376f-7968-468f-aade-9c56e34ddf62 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:12.762401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf376f-7968-468f-aade-9c56e34ddf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:12.762891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf376f-7968-468f-aade-9c56e34ddf62 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:12.763758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf376f-7968-468f-aade-9c56e34ddf62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:12.764281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf376f-7968-468f-aade-9c56e34ddf62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:12.765867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf376f-7968-468f-aade-9c56e34ddf62 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:12.778373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 432/879] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:12.787156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187b30b-9e74-46b0-a7c7-c933352b756a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:12.919570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:12.944087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187b30b-9e74-46b0-a7c7-c933352b756a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:12.983209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfab2bb-682f-4d48-a9e7-d173a2ca7ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:12.983839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfab2bb-682f-4d48-a9e7-d173a2ca7ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:12.984117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfab2bb-682f-4d48-a9e7-d173a2ca7ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:12.984416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfab2bb-682f-4d48-a9e7-d173a2ca7ef0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:12.993058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfab2bb-682f-4d48-a9e7-d173a2ca7ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:12.994536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfab2bb-682f-4d48-a9e7-d173a2ca7ef0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cbfab2bb-682f-4d48-a9e7-d173a2ca7ef0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:13.005804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:13.007575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:13.008582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 448/880] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Aug 31 00:56:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:13.012747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4089bd-6861-4d4a-b45b-0dff8302fce9 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.012747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4089bd-6861-4d4a-b45b-0dff8302fce9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.012747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4089bd-6861-4d4a-b45b-0dff8302fce9 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:13.013612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfab2bb-682f-4d48-a9e7-d173a2ca7ef0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:13.016452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 433/881] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:56:13.020289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e7609-5d31-42ac-8c99-fb4907d17d14 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.020622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e7609-5d31-42ac-8c99-fb4907d17d14 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.020902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e7609-5d31-42ac-8c99-fb4907d17d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:13.043307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-757e7609-5d31-42ac-8c99-fb4907d17d14 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:13.045126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-757e7609-5d31-42ac-8c99-fb4907d17d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:13.145526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 434/882] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:13.149902 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfab2bb-682f-4d48-a9e7-d173a2ca7ef0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:13.186084 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285fcdd-47f1-4ca6-b60a-a621ca10acdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:13.186617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285fcdd-47f1-4ca6-b60a-a621ca10acdb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.186900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285fcdd-47f1-4ca6-b60a-a621ca10acdb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.187178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285fcdd-47f1-4ca6-b60a-a621ca10acdb None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:13.187909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285fcdd-47f1-4ca6-b60a-a621ca10acdb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:13.188220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285fcdd-47f1-4ca6-b60a-a621ca10acdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:13.189675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285fcdd-47f1-4ca6-b60a-a621ca10acdb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:13.199461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:13.209442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 449/883] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Aug 31 00:56:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:13.216249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e7609-5d31-42ac-8c99-fb4907d17d14 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:13.219516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:13.352972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e7609-5d31-42ac-8c99-fb4907d17d14 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:13.390535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413862-bd54-4c95-afa3-08c22a1f12d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:13.391162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413862-bd54-4c95-afa3-08c22a1f12d4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.391449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413862-bd54-4c95-afa3-08c22a1f12d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.391728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413862-bd54-4c95-afa3-08c22a1f12d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:13.417894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285fcdd-47f1-4ca6-b60a-a621ca10acdb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:13.482783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5413862-bd54-4c95-afa3-08c22a1f12d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:13.484455 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5413862-bd54-4c95-afa3-08c22a1f12d4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:13.487325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:13.532774 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285fcdd-47f1-4ca6-b60a-a621ca10acdb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:13.575352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed815b9-6542-494c-af75-52b8ba5b221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:13.576391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed815b9-6542-494c-af75-52b8ba5b221d None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.577058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed815b9-6542-494c-af75-52b8ba5b221d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.577873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed815b9-6542-494c-af75-52b8ba5b221d None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:13.579136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed815b9-6542-494c-af75-52b8ba5b221d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:13.580880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed815b9-6542-494c-af75-52b8ba5b221d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:13.608415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 450/884] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:56:13 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:56:13.622922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 435/885] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:13 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:56:13.628211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c695ff-ee06-48e4-862f-a724e154f1f7 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.628633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413862-bd54-4c95-afa3-08c22a1f12d4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:13.628765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c695ff-ee06-48e4-862f-a724e154f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.629177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c695ff-ee06-48e4-862f-a724e154f1f7 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:13.636855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 451/886] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:13.641230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbf03c-5e5c-42ae-bfc2-f7cdd3751ca1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.641693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbf03c-5e5c-42ae-bfc2-f7cdd3751ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.642146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbf03c-5e5c-42ae-bfc2-f7cdd3751ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:13.680058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8fcbf03c-5e5c-42ae-bfc2-f7cdd3751ca1 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:13.683626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8fcbf03c-5e5c-42ae-bfc2-f7cdd3751ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:13.754332 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413862-bd54-4c95-afa3-08c22a1f12d4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:13.756135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:13.779122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:13.805227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d7abc-0bc5-4783-b991-1376ef03eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:13.805871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d7abc-0bc5-4783-b991-1376ef03eac7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.806154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d7abc-0bc5-4783-b991-1376ef03eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.806419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d7abc-0bc5-4783-b991-1376ef03eac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:13.808218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 452/887] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:13.821633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d7abc-0bc5-4783-b991-1376ef03eac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:13.823145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d7abc-0bc5-4783-b991-1376ef03eac7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:13.836295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557206-327b-4e86-877f-ed5acd8784df None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.836654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557206-327b-4e86-877f-ed5acd8784df None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.836869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557206-327b-4e86-877f-ed5acd8784df None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:13.838196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 453/888] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7d1d7abc-0bc5-4783-b991-1376ef03eac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:13.841677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:13.842638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:13.843515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:13.843515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:13.843515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:13.843515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 436/889] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:13.845033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf402d1-5191-4b19-9e91-2975dd6251e9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.845318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf402d1-5191-4b19-9e91-2975dd6251e9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.845591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf402d1-5191-4b19-9e91-2975dd6251e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:13.849182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d7abc-0bc5-4783-b991-1376ef03eac7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:13.867234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ebf402d1-5191-4b19-9e91-2975dd6251e9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:13.868456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ebf402d1-5191-4b19-9e91-2975dd6251e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:13.954993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d7abc-0bc5-4783-b991-1376ef03eac7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:13.961776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 454/890] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:13.997675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80065-5f64-40c7-a0eb-a4775cf8cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:13.998626 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80065-5f64-40c7-a0eb-a4775cf8cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:13.999085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80065-5f64-40c7-a0eb-a4775cf8cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:13.999533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80065-5f64-40c7-a0eb-a4775cf8cdd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.000444 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80065-5f64-40c7-a0eb-a4775cf8cdd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:14.000943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80065-5f64-40c7-a0eb-a4775cf8cdd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.002567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80065-5f64-40c7-a0eb-a4775cf8cdd4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:14.020587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 437/891] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:14.022711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf402d1-5191-4b19-9e91-2975dd6251e9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:14.097315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80065-5f64-40c7-a0eb-a4775cf8cdd4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:14.115858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:14.137156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf402d1-5191-4b19-9e91-2975dd6251e9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:14.152209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:14.178509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b8bdd-6de8-4cb1-ae00-f56a8eb96ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:14.179222 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8bdd-6de8-4cb1-ae00-f56a8eb96ecb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:14.179501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8bdd-6de8-4cb1-ae00-f56a8eb96ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:14.179773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8bdd-6de8-4cb1-ae00-f56a8eb96ecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.189024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b8bdd-6de8-4cb1-ae00-f56a8eb96ecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.191612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b8bdd-6de8-4cb1-ae00-f56a8eb96ecb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-121b8bdd-6de8-4cb1-ae00-f56a8eb96ecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:14.206963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:14.208150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:14.209117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:14.209117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:14.209117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:14.209117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:14.209117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:14.209117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:14.209117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:14.209117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:14.209117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 455/892] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:14.214268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b8bdd-6de8-4cb1-ae00-f56a8eb96ecb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:14.233168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80065-5f64-40c7-a0eb-a4775cf8cdd4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:14.281232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b873c1-7dd7-488b-b2d0-a37a0f421e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:14.281830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b873c1-7dd7-488b-b2d0-a37a0f421e5e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:14.282099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b873c1-7dd7-488b-b2d0-a37a0f421e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:14.282372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b873c1-7dd7-488b-b2d0-a37a0f421e5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.283056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b873c1-7dd7-488b-b2d0-a37a0f421e5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.284342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b873c1-7dd7-488b-b2d0-a37a0f421e5e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-a3b873c1-7dd7-488b-b2d0-a37a0f421e5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:14.293547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:14.296594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:14.297490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 438/893] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:56:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:14.298285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b873c1-7dd7-488b-b2d0-a37a0f421e5e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:14.344422 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b8bdd-6de8-4cb1-ae00-f56a8eb96ecb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:14.379250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:14.381191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a1bf-b0e1-42d5-ac53-a4a0ba979970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:14.382044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a1bf-b0e1-42d5-ac53-a4a0ba979970 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:14.382325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a1bf-b0e1-42d5-ac53-a4a0ba979970 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:14.382593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a1bf-b0e1-42d5-ac53-a4a0ba979970 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.383288 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a1bf-b0e1-42d5-ac53-a4a0ba979970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:14.383590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a1bf-b0e1-42d5-ac53-a4a0ba979970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.385058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a1bf-b0e1-42d5-ac53-a4a0ba979970 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:14.397066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 456/894] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:14.398425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a1bf-b0e1-42d5-ac53-a4a0ba979970 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:14.415184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b873c1-7dd7-488b-b2d0-a37a0f421e5e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:14.435980 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:14.453547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da60ea-9252-4448-9bf0-a26e337c85d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:14.454184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da60ea-9252-4448-9bf0-a26e337c85d2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:14.454471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da60ea-9252-4448-9bf0-a26e337c85d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:14.454741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da60ea-9252-4448-9bf0-a26e337c85d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.455322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da60ea-9252-4448-9bf0-a26e337c85d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.456721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da60ea-9252-4448-9bf0-a26e337c85d2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b3da60ea-9252-4448-9bf0-a26e337c85d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:14.466607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:14.467619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:14.468572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 439/895] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:14.469416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da60ea-9252-4448-9bf0-a26e337c85d2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:14.515034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a1bf-b0e1-42d5-ac53-a4a0ba979970 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:14.554127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5726c0f-b9c3-4617-9433-ae83bc52daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:14.554845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5726c0f-b9c3-4617-9433-ae83bc52daeb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:14.555200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5726c0f-b9c3-4617-9433-ae83bc52daeb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:14.555389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5726c0f-b9c3-4617-9433-ae83bc52daeb None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.556269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5726c0f-b9c3-4617-9433-ae83bc52daeb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:14.556269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5726c0f-b9c3-4617-9433-ae83bc52daeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.557687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5726c0f-b9c3-4617-9433-ae83bc52daeb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:14.563060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 457/896] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:56:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:14.563611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5726c0f-b9c3-4617-9433-ae83bc52daeb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:14.581709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da60ea-9252-4448-9bf0-a26e337c85d2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:14.620313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18fe1a-72de-4e90-8a5d-556120208de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:14.620940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18fe1a-72de-4e90-8a5d-556120208de1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:14.621222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18fe1a-72de-4e90-8a5d-556120208de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:14.621491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18fe1a-72de-4e90-8a5d-556120208de1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.622217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18fe1a-72de-4e90-8a5d-556120208de1 None admin] RBAC: Adding query filter params (role.id=e01ea2fe7de6460db138fffeaba5c894, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=4f7bdd26be524f6e8354e6fbdcd50136) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:14.622528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18fe1a-72de-4e90-8a5d-556120208de1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.623944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18fe1a-72de-4e90-8a5d-556120208de1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:14.637015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 440/897] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:14 2022] GET /identity/v3/role_assignments?user.id=4f7bdd26be524f6e8354e6fbdcd50136&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=e01ea2fe7de6460db138fffeaba5c894 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:14.637015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18fe1a-72de-4e90-8a5d-556120208de1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:14.637015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:14.698912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:14.704219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5726c0f-b9c3-4617-9433-ae83bc52daeb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:14.762276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97618c-6298-4f57-965f-ff298ef2ec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:14.763066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97618c-6298-4f57-965f-ff298ef2ec8f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:14.763609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97618c-6298-4f57-965f-ff298ef2ec8f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:14.763890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97618c-6298-4f57-965f-ff298ef2ec8f None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.765044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97618c-6298-4f57-965f-ff298ef2ec8f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:14.765629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97618c-6298-4f57-965f-ff298ef2ec8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.767427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18fe1a-72de-4e90-8a5d-556120208de1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:14.767559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97618c-6298-4f57-965f-ff298ef2ec8f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:14.776510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 458/898] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Aug 31 00:56:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:14.781666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97618c-6298-4f57-965f-ff298ef2ec8f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:14.819638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cb6f3-9842-4df1-8996-e6287d324f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:14.820424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cb6f3-9842-4df1-8996-e6287d324f46 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:14.820679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cb6f3-9842-4df1-8996-e6287d324f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:14.820958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cb6f3-9842-4df1-8996-e6287d324f46 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.821801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cb6f3-9842-4df1-8996-e6287d324f46 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:14.822305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cb6f3-9842-4df1-8996-e6287d324f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.823695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cb6f3-9842-4df1-8996-e6287d324f46 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:14.830711 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 441/899] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:56:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:14.836176 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cb6f3-9842-4df1-8996-e6287d324f46 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:14.921024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97618c-6298-4f57-965f-ff298ef2ec8f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:14.940261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cb6f3-9842-4df1-8996-e6287d324f46 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:14.945421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:14.973694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf3131-5102-47dc-b18e-fadfe53859a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:14.974598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf3131-5102-47dc-b18e-fadfe53859a1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:14.975218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf3131-5102-47dc-b18e-fadfe53859a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:14.976297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf3131-5102-47dc-b18e-fadfe53859a1 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.977528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf3131-5102-47dc-b18e-fadfe53859a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:14.978023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf3131-5102-47dc-b18e-fadfe53859a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.980365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf3131-5102-47dc-b18e-fadfe53859a1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:14.985098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f1a25-0532-4516-92eb-f1322788801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:14.985850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f1a25-0532-4516-92eb-f1322788801b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:14.986196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f1a25-0532-4516-92eb-f1322788801b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:14.986541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f1a25-0532-4516-92eb-f1322788801b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:14.987278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 459/900] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Aug 31 00:56:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:14.987389 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f1a25-0532-4516-92eb-f1322788801b None admin] RBAC: Adding query filter params (interface=public, service_id=f297b7f9911a4e39b4825c9978c2d50b, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:14.987683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f1a25-0532-4516-92eb-f1322788801b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:14.991406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f1a25-0532-4516-92eb-f1322788801b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:15.001250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 442/901] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Aug 31 00:56:14 2022] GET /identity/v3/endpoints?service_id=f297b7f9911a4e39b4825c9978c2d50b&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:15.002555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf3131-5102-47dc-b18e-fadfe53859a1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:15.036506 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:15.122153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf3131-5102-47dc-b18e-fadfe53859a1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:15.168149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7ce20-346d-494d-afbf-7dfdf9d132e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:15.168820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7ce20-346d-494d-afbf-7dfdf9d132e8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:15.169080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7ce20-346d-494d-afbf-7dfdf9d132e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:15.169349 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7ce20-346d-494d-afbf-7dfdf9d132e8 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:15.169957 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7ce20-346d-494d-afbf-7dfdf9d132e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:15.171324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7ce20-346d-494d-afbf-7dfdf9d132e8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:15.178034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 460/902] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Aug 31 00:56:15 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:56:15.696769 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7e871-6dbc-47c7-bf80-13505df18107 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:15.697296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7e871-6dbc-47c7-bf80-13505df18107 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:15.697404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7e871-6dbc-47c7-bf80-13505df18107 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:15.698887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 443/903] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:15.704409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecd2d-cd42-408c-8084-ecd1718c4a6f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:15.704849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecd2d-cd42-408c-8084-ecd1718c4a6f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:15.704943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecd2d-cd42-408c-8084-ecd1718c4a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:15.723846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-84fecd2d-cd42-408c-8084-ecd1718c4a6f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:15.725080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-84fecd2d-cd42-408c-8084-ecd1718c4a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:15.821112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 461/904] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:16.092496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7e871-6dbc-47c7-bf80-13505df18107 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:16.207937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7e871-6dbc-47c7-bf80-13505df18107 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:16.239435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:16.246263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38100d-cea1-4d79-8813-fe638684a096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:16.246970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38100d-cea1-4d79-8813-fe638684a096 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:16.247658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38100d-cea1-4d79-8813-fe638684a096 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:16.247993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38100d-cea1-4d79-8813-fe638684a096 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:16.248638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38100d-cea1-4d79-8813-fe638684a096 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:16.250412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38100d-cea1-4d79-8813-fe638684a096 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0d38100d-cea1-4d79-8813-fe638684a096 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:16.260978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:16.261930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:16.262820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 444/905] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Aug 31 00:56:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:16.268357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fecd2d-cd42-408c-8084-ecd1718c4a6f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:16.291548 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:16.387569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fecd2d-cd42-408c-8084-ecd1718c4a6f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:16.430979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ac43-3f09-4d95-a1f1-98ae4f285ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:16.431620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ac43-3f09-4d95-a1f1-98ae4f285ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:16.431909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ac43-3f09-4d95-a1f1-98ae4f285ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:16.432194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ac43-3f09-4d95-a1f1-98ae4f285ad5 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:16.432989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2ac43-3f09-4d95-a1f1-98ae4f285ad5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:16.433302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2ac43-3f09-4d95-a1f1-98ae4f285ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:16.434697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2ac43-3f09-4d95-a1f1-98ae4f285ad5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:16.441300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 462/906] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:16.447122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38100d-cea1-4d79-8813-fe638684a096 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:16.557040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38100d-cea1-4d79-8813-fe638684a096 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:16.593418 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b59183-00f8-4151-8725-6f5486d61c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:16.594044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59183-00f8-4151-8725-6f5486d61c28 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:16.594333 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59183-00f8-4151-8725-6f5486d61c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:16.594635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59183-00f8-4151-8725-6f5486d61c28 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:16.595340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b59183-00f8-4151-8725-6f5486d61c28 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:16.595651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b59183-00f8-4151-8725-6f5486d61c28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:16.597059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b59183-00f8-4151-8725-6f5486d61c28 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:16.602772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 445/907] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:16.608568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ac43-3f09-4d95-a1f1-98ae4f285ad5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:16.702649 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:16.720567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ac43-3f09-4d95-a1f1-98ae4f285ad5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:16.751142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446129f-8ae7-4188-91a3-454cb7426618 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:16.751689 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446129f-8ae7-4188-91a3-454cb7426618 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:16.751771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446129f-8ae7-4188-91a3-454cb7426618 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:16.753385 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 446/908] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:16.759174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658315e-713a-4ab6-a50f-5781b4e6cdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:16.759424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebc3ea-7ec5-4237-a53b-fa799d0a731b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:16.759721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebc3ea-7ec5-4237-a53b-fa799d0a731b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:16.760004 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebc3ea-7ec5-4237-a53b-fa799d0a731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:16.760632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658315e-713a-4ab6-a50f-5781b4e6cdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:16.761092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658315e-713a-4ab6-a50f-5781b4e6cdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:16.761554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658315e-713a-4ab6-a50f-5781b4e6cdf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:16.762522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658315e-713a-4ab6-a50f-5781b4e6cdf9 None admin] RBAC: Adding query filter params (interface=public, service_id=15f8b889c895465081b32bc452527be6, region_id=RegionOne) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:16.763012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658315e-713a-4ab6-a50f-5781b4e6cdf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:16.764568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658315e-713a-4ab6-a50f-5781b4e6cdf9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:16.770753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 463/909] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Aug 31 00:56:16 2022] GET /identity/v3/endpoints?service_id=15f8b889c895465081b32bc452527be6&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:16.778501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658315e-713a-4ab6-a50f-5781b4e6cdf9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:16.781255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e8ebc3ea-7ec5-4237-a53b-fa799d0a731b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:16.782469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e8ebc3ea-7ec5-4237-a53b-fa799d0a731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:16.840516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:16.871724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 447/910] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:16.904071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658315e-713a-4ab6-a50f-5781b4e6cdf9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:16.942369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26438f-5b6d-4ee8-85d7-43205f0a2b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:16.943353 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26438f-5b6d-4ee8-85d7-43205f0a2b51 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:16.943903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26438f-5b6d-4ee8-85d7-43205f0a2b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:16.944941 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26438f-5b6d-4ee8-85d7-43205f0a2b51 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:16.946321 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26438f-5b6d-4ee8-85d7-43205f0a2b51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:16.948724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26438f-5b6d-4ee8-85d7-43205f0a2b51 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:16.955375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 464/911] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Aug 31 00:56:16 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:56:16.973266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241564fd-24ce-4f75-a0ce-9f55a2c002b3 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:16.973905 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241564fd-24ce-4f75-a0ce-9f55a2c002b3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:16.974445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241564fd-24ce-4f75-a0ce-9f55a2c002b3 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:16.977223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 448/912] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:16.982855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526da77-0a69-4d93-9e25-3be959fbd42a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:16.983159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526da77-0a69-4d93-9e25-3be959fbd42a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:16.983401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526da77-0a69-4d93-9e25-3be959fbd42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:17.003595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f526da77-0a69-4d93-9e25-3be959fbd42a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:17.004874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f526da77-0a69-4d93-9e25-3be959fbd42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:17.014754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:17.088428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 465/913] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:17.155564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241564fd-24ce-4f75-a0ce-9f55a2c002b3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:17.268626 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241564fd-24ce-4f75-a0ce-9f55a2c002b3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:17.306211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6149-35d0-4b98-8dda-52c3d367e710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:17.307195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6149-35d0-4b98-8dda-52c3d367e710 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:17.307663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6149-35d0-4b98-8dda-52c3d367e710 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:17.308130 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6149-35d0-4b98-8dda-52c3d367e710 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:17.324428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6149-35d0-4b98-8dda-52c3d367e710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-836e6149-35d0-4b98-8dda-52c3d367e710 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:17.325452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:17.326357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:17.327191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 449/914] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Aug 31 00:56:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:17.334169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526da77-0a69-4d93-9e25-3be959fbd42a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:17.380820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6149-35d0-4b98-8dda-52c3d367e710 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:17.436452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:17.449099 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526da77-0a69-4d93-9e25-3be959fbd42a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:17.492374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa180c-e73b-471e-8257-649437465709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:17.493012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa180c-e73b-471e-8257-649437465709 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:17.493293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa180c-e73b-471e-8257-649437465709 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:17.493566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa180c-e73b-471e-8257-649437465709 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:17.494406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa180c-e73b-471e-8257-649437465709 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:17.494817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa180c-e73b-471e-8257-649437465709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:17.496491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa180c-e73b-471e-8257-649437465709 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:17.508373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6149-35d0-4b98-8dda-52c3d367e710 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:17.511203 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 466/915] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Aug 31 00:56:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:17.512215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa180c-e73b-471e-8257-649437465709 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:17.516041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:17.550014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429d72b-371b-4e90-8dc3-dafb7f92e7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:17.550541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429d72b-371b-4e90-8dc3-dafb7f92e7ff None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:17.550820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429d72b-371b-4e90-8dc3-dafb7f92e7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:17.551092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429d72b-371b-4e90-8dc3-dafb7f92e7ff None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:17.551819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429d72b-371b-4e90-8dc3-dafb7f92e7ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:17.554083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429d72b-371b-4e90-8dc3-dafb7f92e7ff None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:17.580399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 450/916] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:56:17 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:56:17.640940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa180c-e73b-471e-8257-649437465709 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:17.656076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8342f-c222-4ed1-aede-1643e06aa6dc None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:17.656557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8342f-c222-4ed1-aede-1643e06aa6dc None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:17.656866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8342f-c222-4ed1-aede-1643e06aa6dc None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:17.658619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 451/917] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:17.665264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e56916-ebf6-4f53-8a7a-99d0a150c7b8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:17.665557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e56916-ebf6-4f53-8a7a-99d0a150c7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:17.665846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e56916-ebf6-4f53-8a7a-99d0a150c7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:17.698132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bfab9-9502-459b-b930-7313c2b0091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:17.699036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bfab9-9502-459b-b930-7313c2b0091f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:17.699473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bfab9-9502-459b-b930-7313c2b0091f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:17.699899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bfab9-9502-459b-b930-7313c2b0091f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:17.703671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-37e56916-ebf6-4f53-8a7a-99d0a150c7b8 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:17.705022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-37e56916-ebf6-4f53-8a7a-99d0a150c7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:17.713948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bfab9-9502-459b-b930-7313c2b0091f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:17.715705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bfab9-9502-459b-b930-7313c2b0091f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ac7bfab9-9502-459b-b930-7313c2b0091f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:17.732933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:17.734442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:17.735457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:17.735457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:17.735457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:17.737240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 467/918] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:17.743730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bfab9-9502-459b-b930-7313c2b0091f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:17.786012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 452/919] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:17.803142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:17.863510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bfab9-9502-459b-b930-7313c2b0091f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:17.899855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f4ad6-dc16-4fce-bbbc-0efb44ec64d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:17.900503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f4ad6-dc16-4fce-bbbc-0efb44ec64d2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:17.900780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f4ad6-dc16-4fce-bbbc-0efb44ec64d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:17.901054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f4ad6-dc16-4fce-bbbc-0efb44ec64d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:17.901703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f4ad6-dc16-4fce-bbbc-0efb44ec64d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:17.902008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f4ad6-dc16-4fce-bbbc-0efb44ec64d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:17.903377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f4ad6-dc16-4fce-bbbc-0efb44ec64d2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:17.916171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 468/920] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:17.921603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e56916-ebf6-4f53-8a7a-99d0a150c7b8 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:17.965391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:18.037430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e56916-ebf6-4f53-8a7a-99d0a150c7b8 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:18.067061 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f4ad6-dc16-4fce-bbbc-0efb44ec64d2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:18.078100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1cc41-3033-429f-9966-7f2e1deb8e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:18.078747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1cc41-3033-429f-9966-7f2e1deb8e37 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:18.079032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1cc41-3033-429f-9966-7f2e1deb8e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:18.079310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1cc41-3033-429f-9966-7f2e1deb8e37 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:18.088038 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1cc41-3033-429f-9966-7f2e1deb8e37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:18.089754 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1cc41-3033-429f-9966-7f2e1deb8e37 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7de1cc41-3033-429f-9966-7f2e1deb8e37 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:18.103851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:18.104872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:18.105799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 453/921] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Aug 31 00:56:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:18.111216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1cc41-3033-429f-9966-7f2e1deb8e37 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:18.186296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f4ad6-dc16-4fce-bbbc-0efb44ec64d2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:18.201437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:18.222969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:18.227287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64100b-efe2-4679-a013-650247b4338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:18.227673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1cc41-3033-429f-9966-7f2e1deb8e37 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:18.228269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64100b-efe2-4679-a013-650247b4338f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:18.228640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64100b-efe2-4679-a013-650247b4338f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:18.228819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64100b-efe2-4679-a013-650247b4338f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:18.229416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64100b-efe2-4679-a013-650247b4338f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:18.231379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64100b-efe2-4679-a013-650247b4338f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1b64100b-efe2-4679-a013-650247b4338f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:18.240900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:18.243964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:18.246539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 469/922] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:56:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:18.257438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64100b-efe2-4679-a013-650247b4338f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:18.266872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c721e-183b-468d-970e-9ffab29acf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:18.267628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c721e-183b-468d-970e-9ffab29acf86 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:18.267925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c721e-183b-468d-970e-9ffab29acf86 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:18.268206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c721e-183b-468d-970e-9ffab29acf86 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:18.268988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c721e-183b-468d-970e-9ffab29acf86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:18.269302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c721e-183b-468d-970e-9ffab29acf86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:18.270901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c721e-183b-468d-970e-9ffab29acf86 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:18.297999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 454/923] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Aug 31 00:56:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:18.298930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c721e-183b-468d-970e-9ffab29acf86 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:18.371775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64100b-efe2-4679-a013-650247b4338f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:18.409297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa2038-f3cd-403e-9d69-432bdb6c0502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:18.409912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa2038-f3cd-403e-9d69-432bdb6c0502 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:18.410194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa2038-f3cd-403e-9d69-432bdb6c0502 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:18.410473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa2038-f3cd-403e-9d69-432bdb6c0502 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:18.411107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa2038-f3cd-403e-9d69-432bdb6c0502 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:18.411408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa2038-f3cd-403e-9d69-432bdb6c0502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:18.412837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa2038-f3cd-403e-9d69-432bdb6c0502 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:18.423111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 470/924] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:56:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:18.424004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa2038-f3cd-403e-9d69-432bdb6c0502 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:18.425049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c721e-183b-468d-970e-9ffab29acf86 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:18.472878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:18.478098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40366a-b3a0-4e7a-b0fb-90922d703b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:18.479829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40366a-b3a0-4e7a-b0fb-90922d703b2f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:18.480272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40366a-b3a0-4e7a-b0fb-90922d703b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:18.480980 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40366a-b3a0-4e7a-b0fb-90922d703b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:18.495974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40366a-b3a0-4e7a-b0fb-90922d703b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:18.498635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40366a-b3a0-4e7a-b0fb-90922d703b2f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0c40366a-b3a0-4e7a-b0fb-90922d703b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:18.518892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:18.520095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:18.521087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:18.521087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:18.521087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:18.521597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 455/925] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:18.527888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40366a-b3a0-4e7a-b0fb-90922d703b2f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:18.544449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:18.549919 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa2038-f3cd-403e-9d69-432bdb6c0502 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:18.591349 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31797e65-519d-4302-8482-fe40927ec331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:18.591566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31797e65-519d-4302-8482-fe40927ec331 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:18.591856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31797e65-519d-4302-8482-fe40927ec331 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:18.592204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31797e65-519d-4302-8482-fe40927ec331 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:18.593182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31797e65-519d-4302-8482-fe40927ec331 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:18.593693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31797e65-519d-4302-8482-fe40927ec331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:18.595163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31797e65-519d-4302-8482-fe40927ec331 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:18.608063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 471/926] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Aug 31 00:56:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:18.609160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31797e65-519d-4302-8482-fe40927ec331 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:18.682556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40366a-b3a0-4e7a-b0fb-90922d703b2f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:18.727218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d983b07-6dea-4416-b8ba-713ab5990cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:18.728258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d983b07-6dea-4416-b8ba-713ab5990cee None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:18.728838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d983b07-6dea-4416-b8ba-713ab5990cee None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:18.729286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d983b07-6dea-4416-b8ba-713ab5990cee None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:18.730447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d983b07-6dea-4416-b8ba-713ab5990cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:18.730993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d983b07-6dea-4416-b8ba-713ab5990cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:18.733135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d983b07-6dea-4416-b8ba-713ab5990cee None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:18.736672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31797e65-519d-4302-8482-fe40927ec331 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:18.742156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:18.757550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 456/927] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:18.760773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d983b07-6dea-4416-b8ba-713ab5990cee None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:18.796803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d6db0-0af3-432c-a29d-6b4c024510b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:18.798258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6db0-0af3-432c-a29d-6b4c024510b0 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:18.798766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6db0-0af3-432c-a29d-6b4c024510b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:18.799485 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6db0-0af3-432c-a29d-6b4c024510b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:18.800530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d6db0-0af3-432c-a29d-6b4c024510b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:18.802852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d6db0-0af3-432c-a29d-6b4c024510b0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:18.832292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 472/928] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 00:56:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:56:18.858679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:18.901662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d983b07-6dea-4416-b8ba-713ab5990cee None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:18.962348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be717-cbb0-424c-8db5-3a0e7a166c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:18.963785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be717-cbb0-424c-8db5-3a0e7a166c23 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:18.964603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be717-cbb0-424c-8db5-3a0e7a166c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:18.965348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be717-cbb0-424c-8db5-3a0e7a166c23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:18.980806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8be717-cbb0-424c-8db5-3a0e7a166c23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:18.984158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8be717-cbb0-424c-8db5-3a0e7a166c23 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2a8be717-cbb0-424c-8db5-3a0e7a166c23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:19.010283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:19.012370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:19.014197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:19.014197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:19.014197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:19.014197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:19.014197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:19.014197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:19.014197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:19.014197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:19.014197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 457/929] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:19.025401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d6db0-0af3-432c-a29d-6b4c024510b0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:19.149832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d6db0-0af3-432c-a29d-6b4c024510b0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:19.188640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a8d5a-423d-4610-b4c2-fd51ccaff729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:19.189783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8d5a-423d-4610-b4c2-fd51ccaff729 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:19.190352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8d5a-423d-4610-b4c2-fd51ccaff729 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:19.190954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8d5a-423d-4610-b4c2-fd51ccaff729 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:19.192034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a8d5a-423d-4610-b4c2-fd51ccaff729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:19.192639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a8d5a-423d-4610-b4c2-fd51ccaff729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:19.195174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a8d5a-423d-4610-b4c2-fd51ccaff729 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:19.210960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 473/930] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:19.217713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be717-cbb0-424c-8db5-3a0e7a166c23 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:19.336158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d663631-46b8-4c58-8030-ec09806e1808 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:19.336535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d663631-46b8-4c58-8030-ec09806e1808 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:19.336710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d663631-46b8-4c58-8030-ec09806e1808 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:19.338348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 474/931] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:19.347187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49a32-fbe8-46b2-8741-84ad974eddd1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:19.347640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49a32-fbe8-46b2-8741-84ad974eddd1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:19.348067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49a32-fbe8-46b2-8741-84ad974eddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:19.358338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be717-cbb0-424c-8db5-3a0e7a166c23 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:19.385387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c8b49a32-fbe8-46b2-8741-84ad974eddd1 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:19.387938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c8b49a32-fbe8-46b2-8741-84ad974eddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:19.392151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:19.408106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79f12-0997-475c-8f36-df32822a3d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:19.409365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79f12-0997-475c-8f36-df32822a3d90 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:19.409365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79f12-0997-475c-8f36-df32822a3d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:19.409648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79f12-0997-475c-8f36-df32822a3d90 None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/4f7bdd26be524f6e8354e6fbdcd50136/roles/e01ea2fe7de6460db138fffeaba5c894` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:19.412406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c79f12-0997-475c-8f36-df32822a3d90 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=4f7bdd26be524f6e8354e6fbdcd50136, role_id=e01ea2fe7de6460db138fffeaba5c894)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:19.414416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c79f12-0997-475c-8f36-df32822a3d90 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:19.423574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:19.438138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 458/932] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:56:19 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/4f7bdd26be524f6e8354e6fbdcd50136/roles/e01ea2fe7de6460db138fffeaba5c894 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:56:19.498895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 475/933] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:19.783868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79f12-0997-475c-8f36-df32822a3d90 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:19.886399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df13e9-5a4f-46b0-aa5a-8c128960a1d3 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:19.886952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df13e9-5a4f-46b0-aa5a-8c128960a1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:19.887354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df13e9-5a4f-46b0-aa5a-8c128960a1d3 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:19.890318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 476/934] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:19.897497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aac80-39d2-4a11-a64b-12fbf431a99a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:19.897810 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aac80-39d2-4a11-a64b-12fbf431a99a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:19.898090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aac80-39d2-4a11-a64b-12fbf431a99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:19.902004 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79f12-0997-475c-8f36-df32822a3d90 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:19.918015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3c5aac80-39d2-4a11-a64b-12fbf431a99a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:19.919851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3c5aac80-39d2-4a11-a64b-12fbf431a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:19.950303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4875423-87de-4f8b-9273-99c44e05502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:19.950953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875423-87de-4f8b-9273-99c44e05502b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:19.951235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875423-87de-4f8b-9273-99c44e05502b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:19.951509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875423-87de-4f8b-9273-99c44e05502b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:19.952097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4875423-87de-4f8b-9273-99c44e05502b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:19.953497 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4875423-87de-4f8b-9273-99c44e05502b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e4875423-87de-4f8b-9273-99c44e05502b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:19.963845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:19.965011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:56:19.966278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:19.967065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 459/935] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Aug 31 00:56:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:19.976045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4875423-87de-4f8b-9273-99c44e05502b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:20.028673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 477/936] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:20.068791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:20.094969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4875423-87de-4f8b-9273-99c44e05502b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:20.137583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18917a8-f8e9-4730-a286-fca5ce736d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:20.138935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18917a8-f8e9-4730-a286-fca5ce736d7a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:20.139430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18917a8-f8e9-4730-a286-fca5ce736d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:20.139903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18917a8-f8e9-4730-a286-fca5ce736d7a None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:20.140770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18917a8-f8e9-4730-a286-fca5ce736d7a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:20.141298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18917a8-f8e9-4730-a286-fca5ce736d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:20.142858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18917a8-f8e9-4730-a286-fca5ce736d7a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:20.149189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 460/937] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:20.160980 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aac80-39d2-4a11-a64b-12fbf431a99a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:20.279673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aac80-39d2-4a11-a64b-12fbf431a99a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:20.284660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:20.318666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608ea61-c50f-42f2-a408-71b1b4351f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:20.319891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608ea61-c50f-42f2-a408-71b1b4351f94 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:20.320414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608ea61-c50f-42f2-a408-71b1b4351f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:20.320903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608ea61-c50f-42f2-a408-71b1b4351f94 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:20.321786 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608ea61-c50f-42f2-a408-71b1b4351f94 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:20.322311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608ea61-c50f-42f2-a408-71b1b4351f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:20.323895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608ea61-c50f-42f2-a408-71b1b4351f94 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:20.329342 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 478/938] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:20.336071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18917a8-f8e9-4730-a286-fca5ce736d7a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:20.452712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18917a8-f8e9-4730-a286-fca5ce736d7a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:20.462134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608ea61-c50f-42f2-a408-71b1b4351f94 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:20.480772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:20.497251 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9f3aa-f499-4703-88ef-f2d5a7a91edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:20.498063 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9f3aa-f499-4703-88ef-f2d5a7a91edb None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:20.498461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9f3aa-f499-4703-88ef-f2d5a7a91edb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:20.498849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9f3aa-f499-4703-88ef-f2d5a7a91edb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:20.499647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9f3aa-f499-4703-88ef-f2d5a7a91edb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:20.501170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9f3aa-f499-4703-88ef-f2d5a7a91edb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:20.532443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 461/939] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 00:56:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:56:20.673137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608ea61-c50f-42f2-a408-71b1b4351f94 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:20.723388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479bcb5-24ff-459d-8aef-52e6e9053ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:20.724148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479bcb5-24ff-459d-8aef-52e6e9053ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:20.724470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479bcb5-24ff-459d-8aef-52e6e9053ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:20.724804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479bcb5-24ff-459d-8aef-52e6e9053ca5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:20.726156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479bcb5-24ff-459d-8aef-52e6e9053ca5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:20.727929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479bcb5-24ff-459d-8aef-52e6e9053ca5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6479bcb5-24ff-459d-8aef-52e6e9053ca5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:20.739100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:20.740737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:20.746348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 479/940] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:20.756003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9f3aa-f499-4703-88ef-f2d5a7a91edb None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:20.897041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9f3aa-f499-4703-88ef-f2d5a7a91edb None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:20.946951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c5d29-7da9-4b64-af15-f6e8ef7448b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:20.948534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c5d29-7da9-4b64-af15-f6e8ef7448b3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:20.949088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c5d29-7da9-4b64-af15-f6e8ef7448b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:20.949623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c5d29-7da9-4b64-af15-f6e8ef7448b3 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:20.950649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c5d29-7da9-4b64-af15-f6e8ef7448b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:20.951264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c5d29-7da9-4b64-af15-f6e8ef7448b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:20.953125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c5d29-7da9-4b64-af15-f6e8ef7448b3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:20.958895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 462/941] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Aug 31 00:56:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:20.965835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479bcb5-24ff-459d-8aef-52e6e9053ca5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:20.970884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:21.040258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443762b-a767-42ac-bf43-bc90ffb9d5a5 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:21.040636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443762b-a767-42ac-bf43-bc90ffb9d5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:21.040863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443762b-a767-42ac-bf43-bc90ffb9d5a5 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:21.042477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 463/942] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:21.047753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd4be-83f9-458b-97cf-c798a2226086 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:21.048113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd4be-83f9-458b-97cf-c798a2226086 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:21.048422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd4be-83f9-458b-97cf-c798a2226086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:21.068177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-dfcdd4be-83f9-458b-97cf-c798a2226086 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:21.070285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dfcdd4be-83f9-458b-97cf-c798a2226086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:21.098660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:21.110508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479bcb5-24ff-459d-8aef-52e6e9053ca5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:21.173324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d93d50-bee9-465a-b788-cfe7f71cd4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:21.173933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d93d50-bee9-465a-b788-cfe7f71cd4bd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:21.174276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d93d50-bee9-465a-b788-cfe7f71cd4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:21.174550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d93d50-bee9-465a-b788-cfe7f71cd4bd None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:21.175197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d93d50-bee9-465a-b788-cfe7f71cd4bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:21.175581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d93d50-bee9-465a-b788-cfe7f71cd4bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:21.176875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d93d50-bee9-465a-b788-cfe7f71cd4bd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:21.179284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 464/943] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:21.184619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 480/944] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Aug 31 00:56:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:21.190651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdd4be-83f9-458b-97cf-c798a2226086 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:21.299210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdd4be-83f9-458b-97cf-c798a2226086 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:21.338538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72839b4e-5273-480f-a356-97c8a7bf7fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:21.339583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72839b4e-5273-480f-a356-97c8a7bf7fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:21.340100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72839b4e-5273-480f-a356-97c8a7bf7fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:21.340606 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72839b4e-5273-480f-a356-97c8a7bf7fa0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:21.341784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72839b4e-5273-480f-a356-97c8a7bf7fa0 None admin] RBAC: Adding query filter params (interface=public, service_id=38d1e8d126344f039927e795e4b7acb3, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:21.342323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72839b4e-5273-480f-a356-97c8a7bf7fa0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:21.343930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72839b4e-5273-480f-a356-97c8a7bf7fa0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:21.351358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 465/945] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Aug 31 00:56:21 2022] GET /identity/v3/endpoints?service_id=38d1e8d126344f039927e795e4b7acb3&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:21.357277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d93d50-bee9-465a-b788-cfe7f71cd4bd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:21.429079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:21.467502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d93d50-bee9-465a-b788-cfe7f71cd4bd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:21.481631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72839b4e-5273-480f-a356-97c8a7bf7fa0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:21.509358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c97906-9f76-4be2-b1b1-d5453a619a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:21.510029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c97906-9f76-4be2-b1b1-d5453a619a3d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:21.510286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c97906-9f76-4be2-b1b1-d5453a619a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:21.510555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c97906-9f76-4be2-b1b1-d5453a619a3d None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:21.511163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c97906-9f76-4be2-b1b1-d5453a619a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:21.512556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c97906-9f76-4be2-b1b1-d5453a619a3d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:21.516017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:21.519083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 481/946] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Aug 31 00:56:21 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:56:21.620211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72839b4e-5273-480f-a356-97c8a7bf7fa0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:21.670891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:21.671926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:21.672493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:21.673023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:21.674432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:21.677512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:21.683208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WARNING keystone.server.flask.common [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 00:56:21.707224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.sql.core [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:56:21.707224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:56:21.707224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [parameters: {'id': 'e20966d8700e479bbfd5558e51c9e527', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:56:21.707224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81483) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e20966d8700e479bbfd5558e51c9e527.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e20966d8700e479bbfd5558e51c9e527. Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:56:21.714413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application result.read() Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 00:56:21.715248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application yield resource Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise self.value Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application session.commit() Aug 31 00:56:21.717000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:56:21.717873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:56:21.718770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application result.read() Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:56:21.722604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [parameters: {'id': 'e20966d8700e479bbfd5558e51c9e527', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:21.725099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:21.727624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:21.731023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:21.731023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 00:56:21.731023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 00:56:21.731023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:21.731023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:21.731023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 00:56:21.731023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 00:56:21.731023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e20966d8700e479bbfd5558e51c9e527. Aug 31 00:56:21.731023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:21.731023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 466/947] 10.222.0.83 () {60 vars in 1140 bytes} [Wed Aug 31 00:56:21 2022] POST /identity/v3/projects => generated 262 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:21.733994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c97906-9f76-4be2-b1b1-d5453a619a3d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:21.846632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c97906-9f76-4be2-b1b1-d5453a619a3d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:21.880909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:21.883333 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db708d-6075-49fa-b51a-cf92fad46907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:21.884183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db708d-6075-49fa-b51a-cf92fad46907 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:21.884720 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db708d-6075-49fa-b51a-cf92fad46907 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:21.885160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db708d-6075-49fa-b51a-cf92fad46907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:21.892650 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db708d-6075-49fa-b51a-cf92fad46907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:21.894226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db708d-6075-49fa-b51a-cf92fad46907 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-05db708d-6075-49fa-b51a-cf92fad46907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:21.907380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:21.908401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:21.909376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:21.909376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:21.909376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:21.909376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:21.909376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:21.909376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:21.909376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:21.909376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:21.909376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 482/948] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:21.917201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:22.016187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:22.037141 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bdc1e-75af-4a0a-aa31-7f427c0cca2c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:22.075225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a08df9-825d-42e1-b6b6-07dc8dea65ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:22.076213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08df9-825d-42e1-b6b6-07dc8dea65ba None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:22.076733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08df9-825d-42e1-b6b6-07dc8dea65ba None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:22.077250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08df9-825d-42e1-b6b6-07dc8dea65ba None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:22.078162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a08df9-825d-42e1-b6b6-07dc8dea65ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:22.078680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a08df9-825d-42e1-b6b6-07dc8dea65ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:22.080615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a08df9-825d-42e1-b6b6-07dc8dea65ba None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:22.103129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 467/949] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:22.178564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63a30-5eb5-4e7d-b520-4f5ddd2c8cbe None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:22.179097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63a30-5eb5-4e7d-b520-4f5ddd2c8cbe None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:22.179545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63a30-5eb5-4e7d-b520-4f5ddd2c8cbe None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:22.183743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 483/950] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:22.193436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee34c32-55f8-479f-b712-74b92c60e4f6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:22.193934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee34c32-55f8-479f-b712-74b92c60e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:22.195208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee34c32-55f8-479f-b712-74b92c60e4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:22.228001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5ee34c32-55f8-479f-b712-74b92c60e4f6 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:22.230797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5ee34c32-55f8-479f-b712-74b92c60e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:22.362223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 468/951] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:22.648560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b63a30-5eb5-4e7d-b520-4f5ddd2c8cbe None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:22.700243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1266-71ba-4554-adfc-78879d0cc65f None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:22.700466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1266-71ba-4554-adfc-78879d0cc65f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:22.700694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1266-71ba-4554-adfc-78879d0cc65f None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:22.702557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 469/952] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:56:22.707602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099ed44-2d71-4fe7-a9d1-a82f57a06f03 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:22.707883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099ed44-2d71-4fe7-a9d1-a82f57a06f03 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:22.708168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099ed44-2d71-4fe7-a9d1-a82f57a06f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:22.729104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2099ed44-2d71-4fe7-a9d1-a82f57a06f03 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:22.730547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2099ed44-2d71-4fe7-a9d1-a82f57a06f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:22.781194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b63a30-5eb5-4e7d-b520-4f5ddd2c8cbe None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:22.814318 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 470/953] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:22.823686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6031b26-098a-46f9-aadf-4d98a90768b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:22.824648 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6031b26-098a-46f9-aadf-4d98a90768b6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:22.825203 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6031b26-098a-46f9-aadf-4d98a90768b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:22.825705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6031b26-098a-46f9-aadf-4d98a90768b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:22.837603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6031b26-098a-46f9-aadf-4d98a90768b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e6031b26-098a-46f9-aadf-4d98a90768b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:22.843160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:22.844102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:22.845035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:22.847311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 484/954] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Aug 31 00:56:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:22.853388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099ed44-2d71-4fe7-a9d1-a82f57a06f03 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:22.864663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:22.958106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099ed44-2d71-4fe7-a9d1-a82f57a06f03 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:22.993927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54d027-a0ce-4e36-a103-fb9bffcf2fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:22.994548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54d027-a0ce-4e36-a103-fb9bffcf2fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:22.994828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54d027-a0ce-4e36-a103-fb9bffcf2fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:22.995099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54d027-a0ce-4e36-a103-fb9bffcf2fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:22.995766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54d027-a0ce-4e36-a103-fb9bffcf2fa8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:22.996069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54d027-a0ce-4e36-a103-fb9bffcf2fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:22.997462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54d027-a0ce-4e36-a103-fb9bffcf2fa8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:23.006254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 471/955] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Aug 31 00:56:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:23.011859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6031b26-098a-46f9-aadf-4d98a90768b6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:23.067104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:23.095789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54d027-a0ce-4e36-a103-fb9bffcf2fa8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:23.119851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6031b26-098a-46f9-aadf-4d98a90768b6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:23.158887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48372a31-17d4-4947-8dae-78c6df42cab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:23.159778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48372a31-17d4-4947-8dae-78c6df42cab2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:23.160254 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48372a31-17d4-4947-8dae-78c6df42cab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:23.160731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48372a31-17d4-4947-8dae-78c6df42cab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:23.173234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48372a31-17d4-4947-8dae-78c6df42cab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:23.175078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48372a31-17d4-4947-8dae-78c6df42cab2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:23.181766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-48372a31-17d4-4947-8dae-78c6df42cab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:23.193028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:23.195206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:23.196102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:23.196102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:23.196102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:23.198055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 485/956] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:23.203674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48372a31-17d4-4947-8dae-78c6df42cab2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:23.237023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54d027-a0ce-4e36-a103-fb9bffcf2fa8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:23.283224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c57b0-851e-44e0-997d-5aeb43be21c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:23.284775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c57b0-851e-44e0-997d-5aeb43be21c0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:23.285234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c57b0-851e-44e0-997d-5aeb43be21c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:23.285913 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c57b0-851e-44e0-997d-5aeb43be21c0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:23.286651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c57b0-851e-44e0-997d-5aeb43be21c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:23.289370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c57b0-851e-44e0-997d-5aeb43be21c0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-a13c57b0-851e-44e0-997d-5aeb43be21c0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:23.302987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:23.304856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:23.305703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 472/957] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:23.313683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c57b0-851e-44e0-997d-5aeb43be21c0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:23.347964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48372a31-17d4-4947-8dae-78c6df42cab2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:23.351672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:23.391679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8af88-3536-4d0d-abf7-25c88f188c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:23.392473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8af88-3536-4d0d-abf7-25c88f188c76 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:23.392791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8af88-3536-4d0d-abf7-25c88f188c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:23.393075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8af88-3536-4d0d-abf7-25c88f188c76 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:23.393874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8af88-3536-4d0d-abf7-25c88f188c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:23.394186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8af88-3536-4d0d-abf7-25c88f188c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:23.395738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8af88-3536-4d0d-abf7-25c88f188c76 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:23.415548 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 486/958] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:23.421696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8af88-3536-4d0d-abf7-25c88f188c76 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:23.436994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c57b0-851e-44e0-997d-5aeb43be21c0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:23.471255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:23.482209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdeada-5fa0-4939-beb1-644f114f0327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:23.482841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdeada-5fa0-4939-beb1-644f114f0327 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:23.483128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdeada-5fa0-4939-beb1-644f114f0327 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:23.483408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdeada-5fa0-4939-beb1-644f114f0327 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:23.484050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdeada-5fa0-4939-beb1-644f114f0327 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:23.484403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdeada-5fa0-4939-beb1-644f114f0327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:23.485799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdeada-5fa0-4939-beb1-644f114f0327 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:23.496551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 473/959] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:23.498959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdeada-5fa0-4939-beb1-644f114f0327 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:23.563465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8af88-3536-4d0d-abf7-25c88f188c76 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:23.608863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aec5b5-48d1-4418-94cb-6b137dbd8b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:23.609499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aec5b5-48d1-4418-94cb-6b137dbd8b6d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:23.609779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aec5b5-48d1-4418-94cb-6b137dbd8b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:23.610056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aec5b5-48d1-4418-94cb-6b137dbd8b6d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:23.618417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aec5b5-48d1-4418-94cb-6b137dbd8b6d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:23.619864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aec5b5-48d1-4418-94cb-6b137dbd8b6d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:23.620367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdeada-5fa0-4939-beb1-644f114f0327 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f9aec5b5-48d1-4418-94cb-6b137dbd8b6d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:23.632598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:23.635177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:23.636154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 487/960] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Aug 31 00:56:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:23.640087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aec5b5-48d1-4418-94cb-6b137dbd8b6d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:23.667830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f1e64-6199-4f4b-90d5-6456abb3e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:23.668082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:23.668492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1e64-6199-4f4b-90d5-6456abb3e757 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:23.668772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1e64-6199-4f4b-90d5-6456abb3e757 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:23.669171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1e64-6199-4f4b-90d5-6456abb3e757 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:23.669704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1e64-6199-4f4b-90d5-6456abb3e757 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:23.670020 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1e64-6199-4f4b-90d5-6456abb3e757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:23.671388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1e64-6199-4f4b-90d5-6456abb3e757 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:23.676356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 474/961] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:23.681886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04361a2a-e4fc-4a36-ad6a-84e76b448b4f None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:23.682177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04361a2a-e4fc-4a36-ad6a-84e76b448b4f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:23.682457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04361a2a-e4fc-4a36-ad6a-84e76b448b4f None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:23.688228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 475/962] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:23.695056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0f4e8-e69e-4985-bbb1-925fc73bd061 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:23.695602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0f4e8-e69e-4985-bbb1-925fc73bd061 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:23.696433 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0f4e8-e69e-4985-bbb1-925fc73bd061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:23.724377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-39d0f4e8-e69e-4985-bbb1-925fc73bd061 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:23.727079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-39d0f4e8-e69e-4985-bbb1-925fc73bd061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:23.775361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aec5b5-48d1-4418-94cb-6b137dbd8b6d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:23.804898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:23.832362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 476/963] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:23.841795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374b35f-a807-4e8b-95a1-75cdeab3fbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:23.842439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374b35f-a807-4e8b-95a1-75cdeab3fbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:23.842725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374b35f-a807-4e8b-95a1-75cdeab3fbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:23.843003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374b35f-a807-4e8b-95a1-75cdeab3fbf3 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:23.843837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374b35f-a807-4e8b-95a1-75cdeab3fbf3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:23.844152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374b35f-a807-4e8b-95a1-75cdeab3fbf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:23.845672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374b35f-a807-4e8b-95a1-75cdeab3fbf3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:23.872358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 488/964] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Aug 31 00:56:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:23.878740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0f4e8-e69e-4985-bbb1-925fc73bd061 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:23.996391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0f4e8-e69e-4985-bbb1-925fc73bd061 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:24.039563 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108582f2-6760-4139-88cb-77fc8f4ff612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:24.040579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108582f2-6760-4139-88cb-77fc8f4ff612 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:24.041111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108582f2-6760-4139-88cb-77fc8f4ff612 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:24.041580 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108582f2-6760-4139-88cb-77fc8f4ff612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:24.138006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:24.150549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374b35f-a807-4e8b-95a1-75cdeab3fbf3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:24.159667 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108582f2-6760-4139-88cb-77fc8f4ff612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:24.162188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108582f2-6760-4139-88cb-77fc8f4ff612 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:24.249466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:24.276412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374b35f-a807-4e8b-95a1-75cdeab3fbf3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:24.288875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 477/965] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:23 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:56:24.288875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbb59f-283c-4f94-8436-7aea7abecc6e None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:24.288875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbb59f-283c-4f94-8436-7aea7abecc6e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:24.288875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbb59f-283c-4f94-8436-7aea7abecc6e None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:24.288875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 478/966] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:24.293780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c20bf-57db-4b03-8845-6f047c2fe353 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:24.294085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c20bf-57db-4b03-8845-6f047c2fe353 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:24.294368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c20bf-57db-4b03-8845-6f047c2fe353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:24.313753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-650c20bf-57db-4b03-8845-6f047c2fe353 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:24.315064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-650c20bf-57db-4b03-8845-6f047c2fe353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:24.329677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e96fd-43a0-45cd-9bdb-abddb32a2858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:24.330321 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e96fd-43a0-45cd-9bdb-abddb32a2858 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:24.330608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e96fd-43a0-45cd-9bdb-abddb32a2858 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:24.330886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e96fd-43a0-45cd-9bdb-abddb32a2858 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:24.331476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e96fd-43a0-45cd-9bdb-abddb32a2858 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:24.332901 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e96fd-43a0-45cd-9bdb-abddb32a2858 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-226e96fd-43a0-45cd-9bdb-abddb32a2858 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:24.344128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:24.345344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:24.346379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:24.348827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 489/967] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:24.349741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e96fd-43a0-45cd-9bdb-abddb32a2858 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:24.391852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 479/968] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:24.396709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c20bf-57db-4b03-8845-6f047c2fe353 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:24.411452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:24.481020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e96fd-43a0-45cd-9bdb-abddb32a2858 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:24.517896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e9b64-f6dc-4cd8-8e26-3b3569018009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:24.518880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e9b64-f6dc-4cd8-8e26-3b3569018009 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:24.519344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e9b64-f6dc-4cd8-8e26-3b3569018009 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:24.519878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e9b64-f6dc-4cd8-8e26-3b3569018009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:24.523319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c20bf-57db-4b03-8845-6f047c2fe353 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:24.532145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e9b64-f6dc-4cd8-8e26-3b3569018009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:24.533985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e9b64-f6dc-4cd8-8e26-3b3569018009 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:24.542284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6a1e9b64-f6dc-4cd8-8e26-3b3569018009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:24.552388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:24.553383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:24.554852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:24.554852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:24.554852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:24.556771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 490/969] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:24.562675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e9b64-f6dc-4cd8-8e26-3b3569018009 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:24.569113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97a68-0f5c-4d54-a195-5abe8a777004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:24.569731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97a68-0f5c-4d54-a195-5abe8a777004 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:24.570019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97a68-0f5c-4d54-a195-5abe8a777004 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:24.570294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97a68-0f5c-4d54-a195-5abe8a777004 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:24.570937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f97a68-0f5c-4d54-a195-5abe8a777004 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:24.571299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f97a68-0f5c-4d54-a195-5abe8a777004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:24.572764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f97a68-0f5c-4d54-a195-5abe8a777004 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:24.578031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 480/970] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Aug 31 00:56:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:24.583675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97a68-0f5c-4d54-a195-5abe8a777004 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:24.676045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e9b64-f6dc-4cd8-8e26-3b3569018009 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:24.678006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:24.706746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97a68-0f5c-4d54-a195-5abe8a777004 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:24.719805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f93b-fb87-46b2-8d69-608c9308a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:24.720462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f93b-fb87-46b2-8d69-608c9308a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:24.720742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f93b-fb87-46b2-8d69-608c9308a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:24.721014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f93b-fb87-46b2-8d69-608c9308a1d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:24.721666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f93b-fb87-46b2-8d69-608c9308a1d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:24.722029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f93b-fb87-46b2-8d69-608c9308a1d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:24.723340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f93b-fb87-46b2-8d69-608c9308a1d8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:24.743326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 491/971] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:24.743326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f93b-fb87-46b2-8d69-608c9308a1d8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:24.750649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a5095-841e-410d-9452-3e228b98fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:24.751612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5095-841e-410d-9452-3e228b98fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:24.752707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5095-841e-410d-9452-3e228b98fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:24.753172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5095-841e-410d-9452-3e228b98fbc2 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:24.753840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a5095-841e-410d-9452-3e228b98fbc2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:24.754153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a5095-841e-410d-9452-3e228b98fbc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:24.756214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a5095-841e-410d-9452-3e228b98fbc2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:24.763330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 481/972] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Aug 31 00:56:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:24.769455 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a5095-841e-410d-9452-3e228b98fbc2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:24.815746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:24.901988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f93b-fb87-46b2-8d69-608c9308a1d8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:24.927987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a5095-841e-410d-9452-3e228b98fbc2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:24.948315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:24.949457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:24.949809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:24.950150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:24.950874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:24.952938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:24.956801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: WARNING keystone.server.flask.common [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 00:56:24.967521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fe14c-98b0-4905-9609-55a6392618bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:24.968173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe14c-98b0-4905-9609-55a6392618bf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:24.968536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe14c-98b0-4905-9609-55a6392618bf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:24.968850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe14c-98b0-4905-9609-55a6392618bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:24.972453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.sql.core [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:56:24.972453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:56:24.972453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [parameters: {'user_id': 'f8bccb814d8649e0938c341d0d0d42e9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:56:24.972453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81484) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:56:24.976435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fe14c-98b0-4905-9609-55a6392618bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:24.977921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fe14c-98b0-4905-9609-55a6392618bf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application result.read() Aug 31 00:56:24.988543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:56:24.989511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application yield resource Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise self.value Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application session.commit() Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:56:24.990520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:56:24.992041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:56:25.000806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application result.read() Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:56:25.003625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f8bccb814d8649e0938c341d0d0d42e9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:25.005675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 00:56:25.009856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 00:56:25.013684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 00:56:25.013684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 00:56:25.013684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:56:25.013684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:56:25.013684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:56:25.013684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-549fe14c-98b0-4905-9609-55a6392618bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:25.015623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:25.017883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:25.021163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:25.021163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:25.021163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:25.021163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:25.021163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:25.021163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:25.021163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:25.021163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:25.024066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 492/973] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Aug 31 00:56:24 2022] POST /identity/v3/users => generated 160 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:25.024301 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 482/974] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:25.025287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:25.025658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fe14c-98b0-4905-9609-55a6392618bf None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:25.025658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:25.111817 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fe14c-98b0-4905-9609-55a6392618bf None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:25.120456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c82e75-bc6d-443c-bb1b-adc965d18eee None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:25.144820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:25.158984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ffb29-147a-4ad5-a422-f9e26d0fb1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:25.159833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ffb29-147a-4ad5-a422-f9e26d0fb1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:25.159959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ffb29-147a-4ad5-a422-f9e26d0fb1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:25.160150 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ffb29-147a-4ad5-a422-f9e26d0fb1d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:25.160891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ffb29-147a-4ad5-a422-f9e26d0fb1d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:25.161202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ffb29-147a-4ad5-a422-f9e26d0fb1d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:25.163195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ffb29-147a-4ad5-a422-f9e26d0fb1d5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:25.165758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b1b7-8304-4fe5-91fc-74169509b094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:25.166492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b1b7-8304-4fe5-91fc-74169509b094 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:25.166878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b1b7-8304-4fe5-91fc-74169509b094 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:25.167253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b1b7-8304-4fe5-91fc-74169509b094 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:25.168034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1b1b7-8304-4fe5-91fc-74169509b094 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:25.169814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1b1b7-8304-4fe5-91fc-74169509b094 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:25.177035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 483/975] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:25.183527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ffb29-147a-4ad5-a422-f9e26d0fb1d5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:25.200361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 493/976] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 00:56:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:56:25.200361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b1b7-8304-4fe5-91fc-74169509b094 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:25.271042 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:25.317721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ffb29-147a-4ad5-a422-f9e26d0fb1d5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:25.353891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b1b7-8304-4fe5-91fc-74169509b094 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:25.358917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc498-52e5-4c30-87f8-c2494a208ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:25.361037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc498-52e5-4c30-87f8-c2494a208ebd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:25.361552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc498-52e5-4c30-87f8-c2494a208ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:25.362070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc498-52e5-4c30-87f8-c2494a208ebd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:25.374506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bc498-52e5-4c30-87f8-c2494a208ebd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:25.376711 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bc498-52e5-4c30-87f8-c2494a208ebd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7a2bc498-52e5-4c30-87f8-c2494a208ebd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:25.395256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:25.396291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:25.398501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 484/977] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:56:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:25.404231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc498-52e5-4c30-87f8-c2494a208ebd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:25.409522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f29be-1a23-47df-be92-04af4029e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:25.409522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f29be-1a23-47df-be92-04af4029e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:25.409906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f29be-1a23-47df-be92-04af4029e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:25.410038 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f29be-1a23-47df-be92-04af4029e1e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:25.410768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f29be-1a23-47df-be92-04af4029e1e6 None admin] RBAC: Adding query filter params (role.id=e01ea2fe7de6460db138fffeaba5c894, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=4f7bdd26be524f6e8354e6fbdcd50136) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:25.411079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f29be-1a23-47df-be92-04af4029e1e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:25.413348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f29be-1a23-47df-be92-04af4029e1e6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:25.419621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 494/978] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:25 2022] GET /identity/v3/role_assignments?user.id=4f7bdd26be524f6e8354e6fbdcd50136&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=e01ea2fe7de6460db138fffeaba5c894 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:25.531787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc498-52e5-4c30-87f8-c2494a208ebd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:25.563295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:25.578226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d284c-78d6-4fcd-be3a-19de060723e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:25.579017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d284c-78d6-4fcd-be3a-19de060723e8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:25.579404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d284c-78d6-4fcd-be3a-19de060723e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:25.579781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d284c-78d6-4fcd-be3a-19de060723e8 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:25.580640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d284c-78d6-4fcd-be3a-19de060723e8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:25.581093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d284c-78d6-4fcd-be3a-19de060723e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:25.582658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d284c-78d6-4fcd-be3a-19de060723e8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:25.628494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 485/979] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Aug 31 00:56:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:25.715034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc925e0-cc66-48a2-b1a9-80e2993203c3 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:25.715322 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc925e0-cc66-48a2-b1a9-80e2993203c3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:25.715596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc925e0-cc66-48a2-b1a9-80e2993203c3 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:25.717423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 495/980] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:25.723231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bc291-846c-474e-90bc-0db5bffd8048 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:25.723772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bc291-846c-474e-90bc-0db5bffd8048 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:25.724198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bc291-846c-474e-90bc-0db5bffd8048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:25.745289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c66bc291-846c-474e-90bc-0db5bffd8048 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:25.746765 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c66bc291-846c-474e-90bc-0db5bffd8048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:25.833924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 486/981] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:26.105778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc925e0-cc66-48a2-b1a9-80e2993203c3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:26.158614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:26.252054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc925e0-cc66-48a2-b1a9-80e2993203c3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:26.295575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c974ec8-e9fb-4e04-b832-d23cf0d425b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:26.296184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974ec8-e9fb-4e04-b832-d23cf0d425b4 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:26.296496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974ec8-e9fb-4e04-b832-d23cf0d425b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:26.296774 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974ec8-e9fb-4e04-b832-d23cf0d425b4 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:26.297439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c974ec8-e9fb-4e04-b832-d23cf0d425b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:26.298805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c974ec8-e9fb-4e04-b832-d23cf0d425b4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:26.316371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 496/982] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:56:26 2022] POST /identity/v3/services => generated 242 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:56:27.312131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946359-0f37-4920-b851-4d0a00f4d89b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:27.312725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946359-0f37-4920-b851-4d0a00f4d89b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:27.312725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946359-0f37-4920-b851-4d0a00f4d89b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:27.314202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 487/983] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:27.321344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0521c-6443-4887-a2c8-253bff6e2f4a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:27.321855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0521c-6443-4887-a2c8-253bff6e2f4a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:27.321954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0521c-6443-4887-a2c8-253bff6e2f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:27.342077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-52c0521c-6443-4887-a2c8-253bff6e2f4a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:27.343595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-52c0521c-6443-4887-a2c8-253bff6e2f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:27.426377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 497/984] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:27.441270 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1851dcf-cfbd-4eb4-9cb9-0f7c0a6ea403 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:27.441608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1851dcf-cfbd-4eb4-9cb9-0f7c0a6ea403 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:27.441836 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1851dcf-cfbd-4eb4-9cb9-0f7c0a6ea403 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:27.443312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 488/985] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:56:27.449337 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ebf9-bc50-4fe3-9422-d5f5499b17b9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:27.449631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ebf9-bc50-4fe3-9422-d5f5499b17b9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:27.449914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ebf9-bc50-4fe3-9422-d5f5499b17b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:27.469688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-95b5ebf9-bc50-4fe3-9422-d5f5499b17b9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:27.470896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-95b5ebf9-bc50-4fe3-9422-d5f5499b17b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:27.490393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:27.556259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 498/986] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:27.698441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1851dcf-cfbd-4eb4-9cb9-0f7c0a6ea403 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:27.818471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1851dcf-cfbd-4eb4-9cb9-0f7c0a6ea403 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:27.831776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5ebf9-bc50-4fe3-9422-d5f5499b17b9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:27.834028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:27.859821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90795cfe-41ec-441b-b060-8137ca30fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:27.860489 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90795cfe-41ec-441b-b060-8137ca30fa23 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:27.860778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90795cfe-41ec-441b-b060-8137ca30fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:27.861050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90795cfe-41ec-441b-b060-8137ca30fa23 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:27.861641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90795cfe-41ec-441b-b060-8137ca30fa23 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:27.863024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90795cfe-41ec-441b-b060-8137ca30fa23 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-90795cfe-41ec-441b-b060-8137ca30fa23 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:27.873126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:27.874201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:27.875110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 489/987] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:27.880119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90795cfe-41ec-441b-b060-8137ca30fa23 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:27.946556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5ebf9-bc50-4fe3-9422-d5f5499b17b9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:27.983497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8af90-c4e8-49a1-961e-6290060ec56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:27.984060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8af90-c4e8-49a1-961e-6290060ec56b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:27.984365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8af90-c4e8-49a1-961e-6290060ec56b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:27.984649 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8af90-c4e8-49a1-961e-6290060ec56b None admin] PATH_INFO: `/v3/services/image` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:27.985238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8af90-c4e8-49a1-961e-6290060ec56b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:27.986615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8af90-c4e8-49a1-961e-6290060ec56b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e7e8af90-c4e8-49a1-961e-6290060ec56b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:27.996165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:27.997225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:56:27.998046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:27.998776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90795cfe-41ec-441b-b060-8137ca30fa23 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:27.998864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 499/988] 10.222.0.83 () {56 vars in 1105 bytes} [Wed Aug 31 00:56:27 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:28.003173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8af90-c4e8-49a1-961e-6290060ec56b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:28.023248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:28.045124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9f875-b2e5-4b20-a506-36823693436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:28.046086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9f875-b2e5-4b20-a506-36823693436a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:28.046550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9f875-b2e5-4b20-a506-36823693436a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:28.047003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9f875-b2e5-4b20-a506-36823693436a None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:28.047941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9f875-b2e5-4b20-a506-36823693436a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:28.048464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9f875-b2e5-4b20-a506-36823693436a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:28.050123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9f875-b2e5-4b20-a506-36823693436a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:28.061130 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 490/989] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Aug 31 00:56:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:28.062030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9f875-b2e5-4b20-a506-36823693436a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:28.114949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:28.127475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8af90-c4e8-49a1-961e-6290060ec56b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:28.167195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8031dd4-2eac-400d-a43b-d2896d146e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:28.167941 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8031dd4-2eac-400d-a43b-d2896d146e96 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:28.168226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8031dd4-2eac-400d-a43b-d2896d146e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:28.168537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8031dd4-2eac-400d-a43b-d2896d146e96 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:28.169189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8031dd4-2eac-400d-a43b-d2896d146e96 None admin] RBAC: Adding query filter params (name=image) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:28.169498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8031dd4-2eac-400d-a43b-d2896d146e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:28.170881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8031dd4-2eac-400d-a43b-d2896d146e96 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:28.180661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 500/990] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:28.182556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8031dd4-2eac-400d-a43b-d2896d146e96 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:28.192624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9f875-b2e5-4b20-a506-36823693436a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:28.233611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22e12b-266d-4119-bd90-97ccbaeb1403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:28.234563 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22e12b-266d-4119-bd90-97ccbaeb1403 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:28.235032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22e12b-266d-4119-bd90-97ccbaeb1403 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:28.235472 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22e12b-266d-4119-bd90-97ccbaeb1403 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:28.236131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22e12b-266d-4119-bd90-97ccbaeb1403 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:28.236566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22e12b-266d-4119-bd90-97ccbaeb1403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:28.237865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22e12b-266d-4119-bd90-97ccbaeb1403 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:28.249107 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 491/991] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Aug 31 00:56:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:28.250424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22e12b-266d-4119-bd90-97ccbaeb1403 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:28.275999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:28.306557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8031dd4-2eac-400d-a43b-d2896d146e96 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:28.351293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b29e1c-fb02-4413-a6e7-80c1636aa8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:28.352116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b29e1c-fb02-4413-a6e7-80c1636aa8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:28.352412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b29e1c-fb02-4413-a6e7-80c1636aa8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:28.352692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b29e1c-fb02-4413-a6e7-80c1636aa8d1 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:28.353361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b29e1c-fb02-4413-a6e7-80c1636aa8d1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:28.354300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b29e1c-fb02-4413-a6e7-80c1636aa8d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:28.356212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b29e1c-fb02-4413-a6e7-80c1636aa8d1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:28.368366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 501/992] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:28.388134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22e12b-266d-4119-bd90-97ccbaeb1403 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:28.391136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:28.400444 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af221-f35f-4650-b62c-11329c4ed9ce None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:28.400762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af221-f35f-4650-b62c-11329c4ed9ce None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:28.401004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af221-f35f-4650-b62c-11329c4ed9ce None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:28.402671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 502/993] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:28.410085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa6abc-6d1f-474d-be29-762a8ff9bf7b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:28.410408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa6abc-6d1f-474d-be29-762a8ff9bf7b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:28.410647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa6abc-6d1f-474d-be29-762a8ff9bf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:28.437183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f852bc0-67a4-4e52-aa13-fad6b06b8143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:28.437847 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f852bc0-67a4-4e52-aa13-fad6b06b8143 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:28.438133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f852bc0-67a4-4e52-aa13-fad6b06b8143 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:28.438408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f852bc0-67a4-4e52-aa13-fad6b06b8143 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:28.439139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f852bc0-67a4-4e52-aa13-fad6b06b8143 None admin] RBAC: Adding query filter params (interface=admin, service_id=38d1e8d126344f039927e795e4b7acb3, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:28.439450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f852bc0-67a4-4e52-aa13-fad6b06b8143 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:28.440901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f852bc0-67a4-4e52-aa13-fad6b06b8143 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:28.446011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-37fa6abc-6d1f-474d-be29-762a8ff9bf7b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:28.447721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-37fa6abc-6d1f-474d-be29-762a8ff9bf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:28.448295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 492/994] 10.222.0.83 () {56 vars in 1249 bytes} [Wed Aug 31 00:56:28 2022] GET /identity/v3/endpoints?service_id=38d1e8d126344f039927e795e4b7acb3&interface=admin®ion_id=RegionOne => generated 193 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:28.453609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f852bc0-67a4-4e52-aa13-fad6b06b8143 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:28.528045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 503/995] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:28.595274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f852bc0-67a4-4e52-aa13-fad6b06b8143 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:28.657060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef144c4-ee96-4385-94c0-0a1f1bd00fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:28.658428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef144c4-ee96-4385-94c0-0a1f1bd00fef None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:28.659194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef144c4-ee96-4385-94c0-0a1f1bd00fef None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:28.659904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef144c4-ee96-4385-94c0-0a1f1bd00fef None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:28.661436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef144c4-ee96-4385-94c0-0a1f1bd00fef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:28.664187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef144c4-ee96-4385-94c0-0a1f1bd00fef None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:28.678739 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 493/996] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Aug 31 00:56:28 2022] GET /identity/v3/services => generated 1727 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:56:28.823364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa6abc-6d1f-474d-be29-762a8ff9bf7b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:28.918478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:28.947678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa6abc-6d1f-474d-be29-762a8ff9bf7b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:28.991952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c962770-e969-44be-9a1a-4bb4486dd1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:28.992635 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c962770-e969-44be-9a1a-4bb4486dd1de None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:28.992923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c962770-e969-44be-9a1a-4bb4486dd1de None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:28.993201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c962770-e969-44be-9a1a-4bb4486dd1de None admin] PATH_INFO: `/v3/services/compute` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:28.993801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c962770-e969-44be-9a1a-4bb4486dd1de None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:28.995269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c962770-e969-44be-9a1a-4bb4486dd1de None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-0c962770-e969-44be-9a1a-4bb4486dd1de None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:29.004689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:29.005711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:29.007258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 504/997] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:29.012463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef144c4-ee96-4385-94c0-0a1f1bd00fef None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:29.047349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:29.126721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef144c4-ee96-4385-94c0-0a1f1bd00fef None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:29.172982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bec9e6-8c7b-4619-93ef-02e1330b6ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:29.173615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec9e6-8c7b-4619-93ef-02e1330b6ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:29.173904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec9e6-8c7b-4619-93ef-02e1330b6ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:29.174184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec9e6-8c7b-4619-93ef-02e1330b6ed6 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:29.174828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bec9e6-8c7b-4619-93ef-02e1330b6ed6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:29.175140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bec9e6-8c7b-4619-93ef-02e1330b6ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:29.176548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bec9e6-8c7b-4619-93ef-02e1330b6ed6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:29.183733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 494/998] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:29.189713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c962770-e969-44be-9a1a-4bb4486dd1de None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:29.313335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c962770-e969-44be-9a1a-4bb4486dd1de None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:29.347869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc9520-51d4-49eb-bba3-4c0ed5eca24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:29.348515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9520-51d4-49eb-bba3-4c0ed5eca24f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:29.348800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9520-51d4-49eb-bba3-4c0ed5eca24f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:29.349072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9520-51d4-49eb-bba3-4c0ed5eca24f None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:29.349693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc9520-51d4-49eb-bba3-4c0ed5eca24f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:29.349998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc9520-51d4-49eb-bba3-4c0ed5eca24f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:29.351410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc9520-51d4-49eb-bba3-4c0ed5eca24f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:29.356468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 505/999] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:29.362080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bec9e6-8c7b-4619-93ef-02e1330b6ed6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:29.463682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:29.471086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bec9e6-8c7b-4619-93ef-02e1330b6ed6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:29.507644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606decee-bbe9-49f4-b4ad-982201237747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:29.508252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606decee-bbe9-49f4-b4ad-982201237747 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:29.508565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606decee-bbe9-49f4-b4ad-982201237747 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:29.508846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606decee-bbe9-49f4-b4ad-982201237747 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:29.509555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606decee-bbe9-49f4-b4ad-982201237747 None admin] RBAC: Adding query filter params (interface=public, service_id=60f1365de1db46878b28d25eb0131046, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:29.509870 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606decee-bbe9-49f4-b4ad-982201237747 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:29.511294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606decee-bbe9-49f4-b4ad-982201237747 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:29.521040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 495/1000] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Aug 31 00:56:29 2022] GET /identity/v3/endpoints?service_id=60f1365de1db46878b28d25eb0131046&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:29.522118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc9520-51d4-49eb-bba3-4c0ed5eca24f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:29.525027 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:29.629140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc9520-51d4-49eb-bba3-4c0ed5eca24f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:29.662531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee7037-e98f-4da0-879c-b88bc1bf987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:29.663659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7037-e98f-4da0-879c-b88bc1bf987c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:29.663971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7037-e98f-4da0-879c-b88bc1bf987c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:29.664394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7037-e98f-4da0-879c-b88bc1bf987c None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:29.665008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee7037-e98f-4da0-879c-b88bc1bf987c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:29.666432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee7037-e98f-4da0-879c-b88bc1bf987c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:29.680362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 506/1001] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Aug 31 00:56:29 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:56:30.385845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee2c2a-9973-4019-84be-6718f8ce266c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:30.386230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee2c2a-9973-4019-84be-6718f8ce266c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:30.386399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee2c2a-9973-4019-84be-6718f8ce266c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:30.387747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 496/1002] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:30.393499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb6f83-62f4-4cae-a2fb-0a9ac9462584 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:30.394056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb6f83-62f4-4cae-a2fb-0a9ac9462584 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:30.394056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb6f83-62f4-4cae-a2fb-0a9ac9462584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:30.416694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-09fb6f83-62f4-4cae-a2fb-0a9ac9462584 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:30.417834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-09fb6f83-62f4-4cae-a2fb-0a9ac9462584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:30.481954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:30.490995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 507/1003] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:30.708970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9662f-6968-477d-b70a-59423b2c0fa4 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:30.710097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9662f-6968-477d-b70a-59423b2c0fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:30.710097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9662f-6968-477d-b70a-59423b2c0fa4 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:30.711605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 497/1004] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:30.717067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb52f2-79c0-4a9c-9d04-14e0e324b92a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:30.717355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb52f2-79c0-4a9c-9d04-14e0e324b92a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:30.717631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb52f2-79c0-4a9c-9d04-14e0e324b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:30.736622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-36bb52f2-79c0-4a9c-9d04-14e0e324b92a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:30.737820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-36bb52f2-79c0-4a9c-9d04-14e0e324b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:30.763463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9662f-6968-477d-b70a-59423b2c0fa4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:30.828647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 508/1005] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:30.879745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9662f-6968-477d-b70a-59423b2c0fa4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:30.916086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38962b-b6c0-4121-ac01-fbe843b86be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:30.916741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38962b-b6c0-4121-ac01-fbe843b86be4 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:30.917032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38962b-b6c0-4121-ac01-fbe843b86be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:30.917308 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38962b-b6c0-4121-ac01-fbe843b86be4 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:30.917978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38962b-b6c0-4121-ac01-fbe843b86be4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:30.919338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38962b-b6c0-4121-ac01-fbe843b86be4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:30.937499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 498/1006] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:56:30 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:56:31.102527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb52f2-79c0-4a9c-9d04-14e0e324b92a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:31.214319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb52f2-79c0-4a9c-9d04-14e0e324b92a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:31.244845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:31.262036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf22c8-c7f0-4e23-ab28-b1c7b6b39c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:31.262688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf22c8-c7f0-4e23-ab28-b1c7b6b39c27 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:31.262975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf22c8-c7f0-4e23-ab28-b1c7b6b39c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:31.263249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf22c8-c7f0-4e23-ab28-b1c7b6b39c27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:31.263833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf22c8-c7f0-4e23-ab28-b1c7b6b39c27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:31.265238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf22c8-c7f0-4e23-ab28-b1c7b6b39c27 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-89cf22c8-c7f0-4e23-ab28-b1c7b6b39c27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:31.275010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:31.276031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:56:31.277266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:31.278453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 509/1007] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Aug 31 00:56:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:31.282371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38962b-b6c0-4121-ac01-fbe843b86be4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:31.305501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:31.398411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38962b-b6c0-4121-ac01-fbe843b86be4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:31.438655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80cda0-19bb-463e-bd44-d86811c3208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:31.439283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80cda0-19bb-463e-bd44-d86811c3208f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:31.439569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80cda0-19bb-463e-bd44-d86811c3208f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:31.439847 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80cda0-19bb-463e-bd44-d86811c3208f None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:31.440521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80cda0-19bb-463e-bd44-d86811c3208f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:31.440831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80cda0-19bb-463e-bd44-d86811c3208f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:31.442199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80cda0-19bb-463e-bd44-d86811c3208f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:31.452631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 499/1008] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Aug 31 00:56:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:31.453617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf22c8-c7f0-4e23-ab28-b1c7b6b39c27 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:31.563675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf22c8-c7f0-4e23-ab28-b1c7b6b39c27 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:31.607137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3afd92-8519-4bcb-9f36-b439978d59e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:31.607771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3afd92-8519-4bcb-9f36-b439978d59e3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:31.608052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3afd92-8519-4bcb-9f36-b439978d59e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:31.608340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3afd92-8519-4bcb-9f36-b439978d59e3 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:31.608988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3afd92-8519-4bcb-9f36-b439978d59e3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:31.609293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3afd92-8519-4bcb-9f36-b439978d59e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:31.610675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3afd92-8519-4bcb-9f36-b439978d59e3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:31.622099 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 510/1009] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Aug 31 00:56:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:31.622943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80cda0-19bb-463e-bd44-d86811c3208f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:31.666779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515526e-3016-48ba-b3c9-dfbc001b024f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:31.667069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515526e-3016-48ba-b3c9-dfbc001b024f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:31.667256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515526e-3016-48ba-b3c9-dfbc001b024f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:31.668891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 511/1010] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:56:31.673664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7101-5dab-4036-8115-744c499f170f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:31.673946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7101-5dab-4036-8115-744c499f170f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:31.674219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7101-5dab-4036-8115-744c499f170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:31.692939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a55d7101-5dab-4036-8115-744c499f170f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:31.695092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a55d7101-5dab-4036-8115-744c499f170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:31.721131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:31.741602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80cda0-19bb-463e-bd44-d86811c3208f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:31.750879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:31.775036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 512/1011] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:31 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:31.782813 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7e1ec-9004-46fa-bdd7-248755ca8154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:31.783435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7e1ec-9004-46fa-bdd7-248755ca8154 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:31.783721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7e1ec-9004-46fa-bdd7-248755ca8154 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:31.783997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7e1ec-9004-46fa-bdd7-248755ca8154 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:31.784713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7e1ec-9004-46fa-bdd7-248755ca8154 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:31.786074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7e1ec-9004-46fa-bdd7-248755ca8154 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:31.809305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 500/1012] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 00:56:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:56:32.057851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7101-5dab-4036-8115-744c499f170f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:32.182767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7101-5dab-4036-8115-744c499f170f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:32.228845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866bc20-bbdc-406a-8710-d92d997bb2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:32.229489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866bc20-bbdc-406a-8710-d92d997bb2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:32.229771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866bc20-bbdc-406a-8710-d92d997bb2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:32.230045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866bc20-bbdc-406a-8710-d92d997bb2e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:32.230628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866bc20-bbdc-406a-8710-d92d997bb2e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:32.231996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866bc20-bbdc-406a-8710-d92d997bb2e6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d866bc20-bbdc-406a-8710-d92d997bb2e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:32.241782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:32.243891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:56:32.245405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:32.249363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 513/1013] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:32.249900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7e1ec-9004-46fa-bdd7-248755ca8154 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:32.354312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7e1ec-9004-46fa-bdd7-248755ca8154 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:32.387986 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb9dc-138e-4adb-b038-cdc7c0bbd689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:32.388627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb9dc-138e-4adb-b038-cdc7c0bbd689 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:32.388914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb9dc-138e-4adb-b038-cdc7c0bbd689 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:32.389189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb9dc-138e-4adb-b038-cdc7c0bbd689 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:32.389833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb9dc-138e-4adb-b038-cdc7c0bbd689 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:32.390140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb9dc-138e-4adb-b038-cdc7c0bbd689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:32.391501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb9dc-138e-4adb-b038-cdc7c0bbd689 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:32.402142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 501/1014] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:32.403185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866bc20-bbdc-406a-8710-d92d997bb2e6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:32.446998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:32.508697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866bc20-bbdc-406a-8710-d92d997bb2e6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:32.542379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a43fee-86ca-4c6d-b352-fb9235271041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:32.542981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a43fee-86ca-4c6d-b352-fb9235271041 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:32.543257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a43fee-86ca-4c6d-b352-fb9235271041 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:32.543529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a43fee-86ca-4c6d-b352-fb9235271041 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:32.544149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a43fee-86ca-4c6d-b352-fb9235271041 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:32.544553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a43fee-86ca-4c6d-b352-fb9235271041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:32.545909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a43fee-86ca-4c6d-b352-fb9235271041 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:32.550820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 514/1015] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Aug 31 00:56:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:32.556304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb9dc-138e-4adb-b038-cdc7c0bbd689 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:32.567786 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:32.660309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb9dc-138e-4adb-b038-cdc7c0bbd689 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:32.694787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51576007-a37d-4110-8a47-1bd2f28f92d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:32.695395 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51576007-a37d-4110-8a47-1bd2f28f92d7 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:32.695676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51576007-a37d-4110-8a47-1bd2f28f92d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:32.695951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51576007-a37d-4110-8a47-1bd2f28f92d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:32.696657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51576007-a37d-4110-8a47-1bd2f28f92d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:32.698048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51576007-a37d-4110-8a47-1bd2f28f92d7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:32.718947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 502/1016] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 00:56:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:56:32.896530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9737e-a7bc-4001-b98e-e3f51f3853ef None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:32.896817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9737e-a7bc-4001-b98e-e3f51f3853ef None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:32.897744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9737e-a7bc-4001-b98e-e3f51f3853ef None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:32.899120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 515/1017] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:32.904597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4d88-6630-4eaf-9404-ebcf406d1b10 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:32.905048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4d88-6630-4eaf-9404-ebcf406d1b10 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:32.905149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4d88-6630-4eaf-9404-ebcf406d1b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:32.925221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ecfc4d88-6630-4eaf-9404-ebcf406d1b10 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:32.926819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ecfc4d88-6630-4eaf-9404-ebcf406d1b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:32.993941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:33.011328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 503/1018] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:33.292311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9737e-a7bc-4001-b98e-e3f51f3853ef None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:33.408732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9737e-a7bc-4001-b98e-e3f51f3853ef None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:33.411114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:33.450476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7309ab-4eb6-42a4-bae4-d8538549c457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:33.451132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7309ab-4eb6-42a4-bae4-d8538549c457 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:33.451417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7309ab-4eb6-42a4-bae4-d8538549c457 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:33.451696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7309ab-4eb6-42a4-bae4-d8538549c457 None admin] PATH_INFO: `/v3/services/image` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:33.452297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7309ab-4eb6-42a4-bae4-d8538549c457 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:33.453741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7309ab-4eb6-42a4-bae4-d8538549c457 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cb7309ab-4eb6-42a4-bae4-d8538549c457 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:33.464651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:33.466208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:33.468087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 516/1019] 10.222.0.83 () {56 vars in 1105 bytes} [Wed Aug 31 00:56:33 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:33.477486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4d88-6630-4eaf-9404-ebcf406d1b10 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:33.581316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4d88-6630-4eaf-9404-ebcf406d1b10 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:33.618006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb112e95-8fd8-4e99-ab03-0003238b475e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:33.618636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb112e95-8fd8-4e99-ab03-0003238b475e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:33.618919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb112e95-8fd8-4e99-ab03-0003238b475e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:33.619193 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb112e95-8fd8-4e99-ab03-0003238b475e None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:33.619833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb112e95-8fd8-4e99-ab03-0003238b475e None admin] RBAC: Adding query filter params (name=image) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:33.620136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb112e95-8fd8-4e99-ab03-0003238b475e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:33.621565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb112e95-8fd8-4e99-ab03-0003238b475e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:33.632396 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 504/1020] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:33.633519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7309ab-4eb6-42a4-bae4-d8538549c457 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:33.738688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7309ab-4eb6-42a4-bae4-d8538549c457 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:33.774593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d26f7-6b21-407f-b3e5-122f31b064b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:33.775200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d26f7-6b21-407f-b3e5-122f31b064b1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:33.775477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d26f7-6b21-407f-b3e5-122f31b064b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:33.775746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d26f7-6b21-407f-b3e5-122f31b064b1 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:33.776400 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d26f7-6b21-407f-b3e5-122f31b064b1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:33.776704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d26f7-6b21-407f-b3e5-122f31b064b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:33.778447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d26f7-6b21-407f-b3e5-122f31b064b1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:33.789434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 517/1021] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:33.790254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb112e95-8fd8-4e99-ab03-0003238b475e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:33.801656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1c72-55d5-485f-a3c0-b379b9189248 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:33.801945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1c72-55d5-485f-a3c0-b379b9189248 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:33.802221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1c72-55d5-485f-a3c0-b379b9189248 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:33.804207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 518/1022] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:56:33.809433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d425d3-520c-444f-ac64-88a0fb1c830f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:33.809712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d425d3-520c-444f-ac64-88a0fb1c830f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:33.810121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d425d3-520c-444f-ac64-88a0fb1c830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:33.828834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-05d425d3-520c-444f-ac64-88a0fb1c830f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:33.830028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-05d425d3-520c-444f-ac64-88a0fb1c830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:33.852399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:33.859626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:33.903871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb112e95-8fd8-4e99-ab03-0003238b475e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:33.908063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 519/1023] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:33.940071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb25a59-db77-46e6-a089-940c99d92652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:33.940820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb25a59-db77-46e6-a089-940c99d92652 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:33.940992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb25a59-db77-46e6-a089-940c99d92652 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:33.941275 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb25a59-db77-46e6-a089-940c99d92652 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:33.941991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb25a59-db77-46e6-a089-940c99d92652 None admin] RBAC: Adding query filter params (interface=public, service_id=1f4301add25e4177bbe4357031152959, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:33.942305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb25a59-db77-46e6-a089-940c99d92652 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:33.943697 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb25a59-db77-46e6-a089-940c99d92652 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:33.951074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 505/1024] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Aug 31 00:56:33 2022] GET /identity/v3/endpoints?service_id=1f4301add25e4177bbe4357031152959&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:33.956823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d425d3-520c-444f-ac64-88a0fb1c830f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:34.059140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d425d3-520c-444f-ac64-88a0fb1c830f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:34.102300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827e9df-c755-4644-a826-18a3e7d8e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:34.102986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827e9df-c755-4644-a826-18a3e7d8e7fa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:34.103213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827e9df-c755-4644-a826-18a3e7d8e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:34.103489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827e9df-c755-4644-a826-18a3e7d8e7fa None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:34.104104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827e9df-c755-4644-a826-18a3e7d8e7fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:34.105516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827e9df-c755-4644-a826-18a3e7d8e7fa None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:34.116592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 520/1025] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Aug 31 00:56:33 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:56:34.180447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb25a59-db77-46e6-a089-940c99d92652 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:34.300348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb25a59-db77-46e6-a089-940c99d92652 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:34.319364 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:34.338741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b211915-cc5b-41a3-bc28-9b79da090655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:34.339381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b211915-cc5b-41a3-bc28-9b79da090655 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:34.339670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b211915-cc5b-41a3-bc28-9b79da090655 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:34.339952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b211915-cc5b-41a3-bc28-9b79da090655 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:34.341372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b211915-cc5b-41a3-bc28-9b79da090655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:34.342821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b211915-cc5b-41a3-bc28-9b79da090655 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:34.348361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 506/1026] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:34.350734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827e9df-c755-4644-a826-18a3e7d8e7fa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:34.380250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:34.469708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827e9df-c755-4644-a826-18a3e7d8e7fa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:34.505032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef290cd-0b68-4cb1-a038-a4de6c2c66e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:34.505662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef290cd-0b68-4cb1-a038-a4de6c2c66e8 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:34.505944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef290cd-0b68-4cb1-a038-a4de6c2c66e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:34.506229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef290cd-0b68-4cb1-a038-a4de6c2c66e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:34.507563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef290cd-0b68-4cb1-a038-a4de6c2c66e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:34.509089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef290cd-0b68-4cb1-a038-a4de6c2c66e8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:34.538549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 521/1027] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:56:34 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:56:34.815484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd5b88-39fb-498b-a723-99afb22cb632 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:34.815820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd5b88-39fb-498b-a723-99afb22cb632 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:34.816052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd5b88-39fb-498b-a723-99afb22cb632 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:34.817577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 507/1028] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:34.822661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2611d-d53b-4738-b8d2-cb1fba87e08c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:34.823123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2611d-d53b-4738-b8d2-cb1fba87e08c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:34.823211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2611d-d53b-4738-b8d2-cb1fba87e08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:34.842093 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-40b2611d-d53b-4738-b8d2-cb1fba87e08c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:34.843277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-40b2611d-d53b-4738-b8d2-cb1fba87e08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:34.911000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 522/1029] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:35.181848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd5b88-39fb-498b-a723-99afb22cb632 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:35.316967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd5b88-39fb-498b-a723-99afb22cb632 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:35.352861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac873b-6280-454e-8b68-80d7f3b2dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:35.353494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac873b-6280-454e-8b68-80d7f3b2dfaa None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:35.353780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac873b-6280-454e-8b68-80d7f3b2dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:35.354057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac873b-6280-454e-8b68-80d7f3b2dfaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:35.364482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac873b-6280-454e-8b68-80d7f3b2dfaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-78ac873b-6280-454e-8b68-80d7f3b2dfaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:35.369848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:35.370789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:35.371680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:35.375960 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 508/1030] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Aug 31 00:56:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:35.377026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2611d-d53b-4738-b8d2-cb1fba87e08c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:35.388995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:35.487887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2611d-d53b-4738-b8d2-cb1fba87e08c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:35.525546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418562d-f28d-4b10-8d0d-662057ee6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:35.526174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418562d-f28d-4b10-8d0d-662057ee6c2a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:35.526457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418562d-f28d-4b10-8d0d-662057ee6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:35.526731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418562d-f28d-4b10-8d0d-662057ee6c2a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:35.527400 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418562d-f28d-4b10-8d0d-662057ee6c2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:35.527705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418562d-f28d-4b10-8d0d-662057ee6c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:35.529108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418562d-f28d-4b10-8d0d-662057ee6c2a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:35.538764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 523/1031] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Aug 31 00:56:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:35.544353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac873b-6280-454e-8b68-80d7f3b2dfaa None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:35.603259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:35.674278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac873b-6280-454e-8b68-80d7f3b2dfaa None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:35.717994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c451cc-cece-453c-951a-f433324b3699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:35.718646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c451cc-cece-453c-951a-f433324b3699 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:35.718937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c451cc-cece-453c-951a-f433324b3699 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:35.719220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c451cc-cece-453c-951a-f433324b3699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:35.730588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c451cc-cece-453c-951a-f433324b3699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:35.732061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c451cc-cece-453c-951a-f433324b3699 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c6c451cc-cece-453c-951a-f433324b3699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:35.747588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:35.748854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:35.749858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:35.749858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:35.749858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:35.749858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 509/1032] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:35.755994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418562d-f28d-4b10-8d0d-662057ee6c2a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:35.829344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:35.864790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418562d-f28d-4b10-8d0d-662057ee6c2a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:35.918376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3038d-7c87-4518-b60b-b2bb2f75bee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:35.919008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3038d-7c87-4518-b60b-b2bb2f75bee5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:35.919293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3038d-7c87-4518-b60b-b2bb2f75bee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:35.919571 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3038d-7c87-4518-b60b-b2bb2f75bee5 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:35.920229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3038d-7c87-4518-b60b-b2bb2f75bee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:35.920585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3038d-7c87-4518-b60b-b2bb2f75bee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:35.921967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3038d-7c87-4518-b60b-b2bb2f75bee5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:35.940048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 524/1033] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:35.942089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c451cc-cece-453c-951a-f433324b3699 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:36.046569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:36.051949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c451cc-cece-453c-951a-f433324b3699 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:36.087283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8db519-6e50-4d4c-ade2-62b7f701b9fc None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:36.087851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8db519-6e50-4d4c-ade2-62b7f701b9fc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:36.088140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8db519-6e50-4d4c-ade2-62b7f701b9fc None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:36.089954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 525/1034] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:36.096363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e399883-d912-45de-8e29-359487956abd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:36.096864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e399883-d912-45de-8e29-359487956abd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:36.097148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e399883-d912-45de-8e29-359487956abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:36.100100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e3963-dd7e-4ab0-8be4-4ce1c7887036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:36.101306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3963-dd7e-4ab0-8be4-4ce1c7887036 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:36.101543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3963-dd7e-4ab0-8be4-4ce1c7887036 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:36.101818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3963-dd7e-4ab0-8be4-4ce1c7887036 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:36.111425 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e3963-dd7e-4ab0-8be4-4ce1c7887036 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:36.112926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e3963-dd7e-4ab0-8be4-4ce1c7887036 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:36.117168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4e399883-d912-45de-8e29-359487956abd None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:36.118356 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4e399883-d912-45de-8e29-359487956abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-fe9e3963-dd7e-4ab0-8be4-4ce1c7887036 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:36.127178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:36.128160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:36.134887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 510/1035] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Aug 31 00:56:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:36.135487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e3963-dd7e-4ab0-8be4-4ce1c7887036 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:36.200655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 526/1036] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:36.256939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e3963-dd7e-4ab0-8be4-4ce1c7887036 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:36.292976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913df58-b7e0-4097-b7a0-9486797d41e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:36.293598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913df58-b7e0-4097-b7a0-9486797d41e9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:36.293882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913df58-b7e0-4097-b7a0-9486797d41e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:36.294159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913df58-b7e0-4097-b7a0-9486797d41e9 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:36.294892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913df58-b7e0-4097-b7a0-9486797d41e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:36.295202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913df58-b7e0-4097-b7a0-9486797d41e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:36.296705 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913df58-b7e0-4097-b7a0-9486797d41e9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:36.320804 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 511/1037] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Aug 31 00:56:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:36.322213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e399883-d912-45de-8e29-359487956abd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:36.385579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:36.437310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e399883-d912-45de-8e29-359487956abd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:36.472343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43373b17-f8fb-4d3f-bae1-7f74932352e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:36.472989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43373b17-f8fb-4d3f-bae1-7f74932352e8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:36.473226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913df58-b7e0-4097-b7a0-9486797d41e9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:36.473334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43373b17-f8fb-4d3f-bae1-7f74932352e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:36.473542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43373b17-f8fb-4d3f-bae1-7f74932352e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:36.495104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:36.555174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43373b17-f8fb-4d3f-bae1-7f74932352e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:36.558042 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43373b17-f8fb-4d3f-bae1-7f74932352e8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:36.595297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913df58-b7e0-4097-b7a0-9486797d41e9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:36.625770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:36.636505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd7bbc-296b-4811-9bd3-9056143d64a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:36.637152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd7bbc-296b-4811-9bd3-9056143d64a5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:36.637438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd7bbc-296b-4811-9bd3-9056143d64a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:36.637719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd7bbc-296b-4811-9bd3-9056143d64a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:36.638404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd7bbc-296b-4811-9bd3-9056143d64a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:36.639792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd7bbc-296b-4811-9bd3-9056143d64a5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-a5fd7bbc-296b-4811-9bd3-9056143d64a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:36.650727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:36.652031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:36.653225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 512/1038] 10.222.0.83 () {56 vars in 1105 bytes} [Wed Aug 31 00:56:36 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:36.654034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fb43d-8d1f-4cbc-96f4-ed07a1c4f41e None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:36.654034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fb43d-8d1f-4cbc-96f4-ed07a1c4f41e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:36.654034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fb43d-8d1f-4cbc-96f4-ed07a1c4f41e None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:36.655097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 513/1039] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:36.657661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fb43d-8d1f-4cbc-96f4-ed07a1c4f41e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:36.680991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 527/1040] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:56:36.680991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a1722-3884-4624-9bbf-c42a0c91f67c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:36.680991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a1722-3884-4624-9bbf-c42a0c91f67c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:36.680991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a1722-3884-4624-9bbf-c42a0c91f67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:36.696332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-105a1722-3884-4624-9bbf-c42a0c91f67c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:36.697572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-105a1722-3884-4624-9bbf-c42a0c91f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:36.746148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:36.767250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fb43d-8d1f-4cbc-96f4-ed07a1c4f41e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:36.769841 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 528/1041] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:36.770771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a1722-3884-4624-9bbf-c42a0c91f67c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:36.815919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4c5b-854c-4fba-8da9-607ba3e585bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:36.816835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4c5b-854c-4fba-8da9-607ba3e585bf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:36.817299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4c5b-854c-4fba-8da9-607ba3e585bf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:36.817755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4c5b-854c-4fba-8da9-607ba3e585bf None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:36.818856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb4c5b-854c-4fba-8da9-607ba3e585bf None admin] RBAC: Adding query filter params (name=image) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:36.819376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb4c5b-854c-4fba-8da9-607ba3e585bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:36.821783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb4c5b-854c-4fba-8da9-607ba3e585bf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:36.830465 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 514/1042] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:36.841279 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4c5b-854c-4fba-8da9-607ba3e585bf None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:36.904704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:36.916869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a1722-3884-4624-9bbf-c42a0c91f67c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:36.954809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218e4ed-93d4-424d-8d87-193d950d979f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:36.955459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218e4ed-93d4-424d-8d87-193d950d979f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:36.955744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218e4ed-93d4-424d-8d87-193d950d979f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:36.956023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218e4ed-93d4-424d-8d87-193d950d979f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:36.967519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218e4ed-93d4-424d-8d87-193d950d979f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:36.969026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218e4ed-93d4-424d-8d87-193d950d979f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:36.971300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4c5b-854c-4fba-8da9-607ba3e585bf None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6218e4ed-93d4-424d-8d87-193d950d979f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:36.985296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:36.986357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:36.987274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:36.987274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:36.987274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:36.987274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 529/1043] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:36.992298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218e4ed-93d4-424d-8d87-193d950d979f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:37.014633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d103ff-a303-475b-acea-9b561968a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:37.015588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d103ff-a303-475b-acea-9b561968a634 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:37.015588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d103ff-a303-475b-acea-9b561968a634 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:37.015845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d103ff-a303-475b-acea-9b561968a634 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:37.016485 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d103ff-a303-475b-acea-9b561968a634 None admin] RBAC: Adding query filter params (type=image) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:37.016805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d103ff-a303-475b-acea-9b561968a634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:37.018179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d103ff-a303-475b-acea-9b561968a634 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:37.025126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 515/1044] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:37.030605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d103ff-a303-475b-acea-9b561968a634 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:37.043337 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:37.098782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218e4ed-93d4-424d-8d87-193d950d979f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:37.134224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb126d4e-78b2-4b7e-a4de-4d03a746b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:37.134840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb126d4e-78b2-4b7e-a4de-4d03a746b6de None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:37.135117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb126d4e-78b2-4b7e-a4de-4d03a746b6de None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:37.135390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb126d4e-78b2-4b7e-a4de-4d03a746b6de None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:37.136037 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb126d4e-78b2-4b7e-a4de-4d03a746b6de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:37.136360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb126d4e-78b2-4b7e-a4de-4d03a746b6de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:37.137788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb126d4e-78b2-4b7e-a4de-4d03a746b6de None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:37.142643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d103ff-a303-475b-acea-9b561968a634 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:37.150714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 530/1045] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:37.151601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb126d4e-78b2-4b7e-a4de-4d03a746b6de None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:37.154329 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:37.186187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12651db4-cb6c-4be9-91e3-50e58556e3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:37.186813 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12651db4-cb6c-4be9-91e3-50e58556e3d2 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:37.187106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12651db4-cb6c-4be9-91e3-50e58556e3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:37.187389 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12651db4-cb6c-4be9-91e3-50e58556e3d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:37.188069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12651db4-cb6c-4be9-91e3-50e58556e3d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:37.189483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12651db4-cb6c-4be9-91e3-50e58556e3d2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:37.211702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 516/1046] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 00:56:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:56:37.212604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12651db4-cb6c-4be9-91e3-50e58556e3d2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:37.283687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:37.290681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb126d4e-78b2-4b7e-a4de-4d03a746b6de None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:37.338815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12651db4-cb6c-4be9-91e3-50e58556e3d2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:37.339286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507f3c-a43c-46ce-96b6-675ceb048c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:37.339946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507f3c-a43c-46ce-96b6-675ceb048c16 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:37.340231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507f3c-a43c-46ce-96b6-675ceb048c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:37.340548 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507f3c-a43c-46ce-96b6-675ceb048c16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:37.342007 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77507f3c-a43c-46ce-96b6-675ceb048c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:37.343481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77507f3c-a43c-46ce-96b6-675ceb048c16 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:37.345201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 531/1047] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:37.351852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507f3c-a43c-46ce-96b6-675ceb048c16 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:37.387609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d61a4-44fd-426d-aa91-300600385592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:37.388900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d61a4-44fd-426d-aa91-300600385592 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:37.388900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d61a4-44fd-426d-aa91-300600385592 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:37.388900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d61a4-44fd-426d-aa91-300600385592 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:37.396853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d61a4-44fd-426d-aa91-300600385592 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:37.399630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d61a4-44fd-426d-aa91-300600385592 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b58d61a4-44fd-426d-aa91-300600385592 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:37.411330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:37.412535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:37.413634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:37.413634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:37.413634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:37.413634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:37.413634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:37.413634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:37.413634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:37.413634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:37.414324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 517/1048] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:37.419607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d61a4-44fd-426d-aa91-300600385592 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:37.440054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:37.479014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507f3c-a43c-46ce-96b6-675ceb048c16 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:37.515742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f802f81-4360-4b0e-b80e-3859a735be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:37.516388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f802f81-4360-4b0e-b80e-3859a735be26 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:37.516677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f802f81-4360-4b0e-b80e-3859a735be26 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:37.516959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f802f81-4360-4b0e-b80e-3859a735be26 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:37.517621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f802f81-4360-4b0e-b80e-3859a735be26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:37.519039 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f802f81-4360-4b0e-b80e-3859a735be26 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:37.534548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d61a4-44fd-426d-aa91-300600385592 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:37.548880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 532/1049] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:56:37 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:56:37.570951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:37.588730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37cd64-9f1c-4908-820b-3a2ed2ba8ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:37.589361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37cd64-9f1c-4908-820b-3a2ed2ba8ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:37.589644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37cd64-9f1c-4908-820b-3a2ed2ba8ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:37.589940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37cd64-9f1c-4908-820b-3a2ed2ba8ef5 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:37.590655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37cd64-9f1c-4908-820b-3a2ed2ba8ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:37.591229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37cd64-9f1c-4908-820b-3a2ed2ba8ef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:37.592740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37cd64-9f1c-4908-820b-3a2ed2ba8ef5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:37.613564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 518/1050] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:37.614895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f802f81-4360-4b0e-b80e-3859a735be26 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:37.739305 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f802f81-4360-4b0e-b80e-3859a735be26 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:37.764817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:37.778711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d2d62-376a-4d88-a786-a7152c340658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:37.779331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d2d62-376a-4d88-a786-a7152c340658 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:37.779611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d2d62-376a-4d88-a786-a7152c340658 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:37.779888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d2d62-376a-4d88-a786-a7152c340658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:37.780654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d2d62-376a-4d88-a786-a7152c340658 None admin] RBAC: Adding query filter params (role.id=e01ea2fe7de6460db138fffeaba5c894, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=a99d74d9d72c4fc2a363ce6559e4ddff) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:37.780968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d2d62-376a-4d88-a786-a7152c340658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:37.782406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d2d62-376a-4d88-a786-a7152c340658 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:37.788541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 533/1051] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:37 2022] GET /identity/v3/role_assignments?user.id=a99d74d9d72c4fc2a363ce6559e4ddff&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=e01ea2fe7de6460db138fffeaba5c894 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:39.205714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c724b-9c48-49d1-8ee6-d16e85782a2d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:39.206238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c724b-9c48-49d1-8ee6-d16e85782a2d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:39.206350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c724b-9c48-49d1-8ee6-d16e85782a2d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:39.207787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 519/1052] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:39.213272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef690455-db7a-471d-9101-c1398444f718 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:39.213731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef690455-db7a-471d-9101-c1398444f718 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:39.213811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef690455-db7a-471d-9101-c1398444f718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:39.233355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ef690455-db7a-471d-9101-c1398444f718 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:39.234545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ef690455-db7a-471d-9101-c1398444f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:39.309177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 534/1053] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:39.567542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e5746-3a1b-452f-ae88-8a3374d6528a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:39.567897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e5746-3a1b-452f-ae88-8a3374d6528a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:39.568024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e5746-3a1b-452f-ae88-8a3374d6528a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:39.570566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 520/1054] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:39.576133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169aaf-7a75-4af3-9d88-dd982edf06ca None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:39.576484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169aaf-7a75-4af3-9d88-dd982edf06ca None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:39.576762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169aaf-7a75-4af3-9d88-dd982edf06ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:39.578163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e5746-3a1b-452f-ae88-8a3374d6528a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:39.595526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9f169aaf-7a75-4af3-9d88-dd982edf06ca None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:39.597069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9f169aaf-7a75-4af3-9d88-dd982edf06ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:39.678404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 535/1055] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:39.696393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e5746-3a1b-452f-ae88-8a3374d6528a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:39.710742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f705-6937-4bcc-9fa3-3924d8c383cb None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:39.711087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f705-6937-4bcc-9fa3-3924d8c383cb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:39.711427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f705-6937-4bcc-9fa3-3924d8c383cb None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:39.713004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 536/1056] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:56:39.718369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75f88-8667-4fa9-8e82-25fc75128bfc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:39.718659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75f88-8667-4fa9-8e82-25fc75128bfc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:39.718944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75f88-8667-4fa9-8e82-25fc75128bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:39.733860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040aaf7-f2de-4dcf-aa17-c776f1e4ca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:39.734476 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040aaf7-f2de-4dcf-aa17-c776f1e4ca74 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:39.734757 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040aaf7-f2de-4dcf-aa17-c776f1e4ca74 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:39.735032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040aaf7-f2de-4dcf-aa17-c776f1e4ca74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:39.737414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c7f75f88-8667-4fa9-8e82-25fc75128bfc None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:39.738606 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c7f75f88-8667-4fa9-8e82-25fc75128bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:39.782577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:39.790112 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:39.811640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040aaf7-f2de-4dcf-aa17-c776f1e4ca74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:39.820466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 537/1057] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:39.820608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040aaf7-f2de-4dcf-aa17-c776f1e4ca74 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:39.915875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 521/1058] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:56:39.921768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75f88-8667-4fa9-8e82-25fc75128bfc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:39.950102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040aaf7-f2de-4dcf-aa17-c776f1e4ca74 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:40.033213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75f88-8667-4fa9-8e82-25fc75128bfc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:40.036222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:40.060430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040aaf7-f2de-4dcf-aa17-c776f1e4ca74 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:40.073346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ca42d-e55a-4f54-bd1c-e9ad6882ccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:40.073917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ca42d-e55a-4f54-bd1c-e9ad6882ccab None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:40.074202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ca42d-e55a-4f54-bd1c-e9ad6882ccab None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:40.074480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ca42d-e55a-4f54-bd1c-e9ad6882ccab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:40.084879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ca42d-e55a-4f54-bd1c-e9ad6882ccab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:40.086337 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ca42d-e55a-4f54-bd1c-e9ad6882ccab None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:40.096680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec88d0-bb7b-4ef4-b906-835128effe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:40.097321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec88d0-bb7b-4ef4-b906-835128effe93 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:40.097607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec88d0-bb7b-4ef4-b906-835128effe93 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:40.097882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec88d0-bb7b-4ef4-b906-835128effe93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f99ca42d-e55a-4f54-bd1c-e9ad6882ccab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:40.101323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:40.102704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:40.104147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:40.104147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:40.104147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:40.104147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 538/1059] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:40.104147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ca42d-e55a-4f54-bd1c-e9ad6882ccab None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:40.110093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec88d0-bb7b-4ef4-b906-835128effe93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c4ec88d0-bb7b-4ef4-b906-835128effe93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:40.114930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:40.117138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 522/1060] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:40.118441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec88d0-bb7b-4ef4-b906-835128effe93 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:40.138381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:40.222002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ca42d-e55a-4f54-bd1c-e9ad6882ccab None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:40.245057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec88d0-bb7b-4ef4-b906-835128effe93 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:40.256615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d01d3-0607-4252-81ef-029bc69dcd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:40.257822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d01d3-0607-4252-81ef-029bc69dcd44 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:40.258332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d01d3-0607-4252-81ef-029bc69dcd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:40.258817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d01d3-0607-4252-81ef-029bc69dcd44 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:40.271614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d01d3-0607-4252-81ef-029bc69dcd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-182d01d3-0607-4252-81ef-029bc69dcd44 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:40.277208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:40.278208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 539/1061] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Aug 31 00:56:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:40.279308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d01d3-0607-4252-81ef-029bc69dcd44 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:40.301183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c572d46-09bf-49cf-9100-24b4818c6920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:40.301800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572d46-09bf-49cf-9100-24b4818c6920 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:40.302090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572d46-09bf-49cf-9100-24b4818c6920 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:40.302369 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572d46-09bf-49cf-9100-24b4818c6920 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:40.303844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c572d46-09bf-49cf-9100-24b4818c6920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:40.304616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c572d46-09bf-49cf-9100-24b4818c6920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:40.305364 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c572d46-09bf-49cf-9100-24b4818c6920 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:40.314170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:40.328628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 523/1062] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:40.328628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c572d46-09bf-49cf-9100-24b4818c6920 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:40.394376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:40.410070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d01d3-0607-4252-81ef-029bc69dcd44 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:40.457939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcce39-dfa5-42eb-8af3-5a522e0e5a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:40.458571 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcce39-dfa5-42eb-8af3-5a522e0e5a45 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:40.458851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcce39-dfa5-42eb-8af3-5a522e0e5a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:40.459125 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcce39-dfa5-42eb-8af3-5a522e0e5a45 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:40.459945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcce39-dfa5-42eb-8af3-5a522e0e5a45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:40.460248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcce39-dfa5-42eb-8af3-5a522e0e5a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:40.461675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcce39-dfa5-42eb-8af3-5a522e0e5a45 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:40.468704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c572d46-09bf-49cf-9100-24b4818c6920 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:40.471483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 540/1063] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:40.478054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcce39-dfa5-42eb-8af3-5a522e0e5a45 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:40.508683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d91a-3647-4eab-b5f0-0524a7a799f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:40.509319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d91a-3647-4eab-b5f0-0524a7a799f5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:40.509604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d91a-3647-4eab-b5f0-0524a7a799f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:40.509878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d91a-3647-4eab-b5f0-0524a7a799f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:40.510556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769d91a-3647-4eab-b5f0-0524a7a799f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:40.510867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769d91a-3647-4eab-b5f0-0524a7a799f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:40.512241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769d91a-3647-4eab-b5f0-0524a7a799f5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:40.523865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 524/1064] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Aug 31 00:56:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:40.529460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d91a-3647-4eab-b5f0-0524a7a799f5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:40.605142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcce39-dfa5-42eb-8af3-5a522e0e5a45 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:40.611035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:40.644428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f3ba9-8c1d-4dab-9b92-9c332ced0d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:40.645070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f3ba9-8c1d-4dab-9b92-9c332ced0d89 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:40.645347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f3ba9-8c1d-4dab-9b92-9c332ced0d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:40.645620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f3ba9-8c1d-4dab-9b92-9c332ced0d89 None admin] PATH_INFO: `/v3/users/f3a93805807a4c43ad53e7b3cc87c327` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:40.657485 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d91a-3647-4eab-b5f0-0524a7a799f5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:40.659611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f3ba9-8c1d-4dab-9b92-9c332ced0d89 None admin] RBAC: Authorizing `identity:get_user(user_id=f3a93805807a4c43ad53e7b3cc87c327)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:40.661087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f3ba9-8c1d-4dab-9b92-9c332ced0d89 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:40.663588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 541/1065] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:56:40 2022] GET /identity/v3/users/f3a93805807a4c43ad53e7b3cc87c327 => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:40.669606 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f3ba9-8c1d-4dab-9b92-9c332ced0d89 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:40.682160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:40.694514 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e22f4b-7340-4980-a08e-b1c707bc9356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:40.695179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e22f4b-7340-4980-a08e-b1c707bc9356 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:40.695465 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e22f4b-7340-4980-a08e-b1c707bc9356 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:40.695745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e22f4b-7340-4980-a08e-b1c707bc9356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:40.706235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e22f4b-7340-4980-a08e-b1c707bc9356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:40.707678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e22f4b-7340-4980-a08e-b1c707bc9356 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d2e22f4b-7340-4980-a08e-b1c707bc9356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:40.722343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:40.723355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:40.729558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:40.729558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:40.729558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:40.729558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 525/1066] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:40.729828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e22f4b-7340-4980-a08e-b1c707bc9356 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:40.777035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f3ba9-8c1d-4dab-9b92-9c332ced0d89 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:40.815021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6b416-eab4-44f9-af27-df68d99e23d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:40.815930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b416-eab4-44f9-af27-df68d99e23d3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:40.815930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b416-eab4-44f9-af27-df68d99e23d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:40.816359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b416-eab4-44f9-af27-df68d99e23d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:40.845647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e22f4b-7340-4980-a08e-b1c707bc9356 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:40.856019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:40.877431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dbf52-846a-4352-86a4-27a2cc2b88c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:40.878050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbf52-846a-4352-86a4-27a2cc2b88c6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:40.878494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbf52-846a-4352-86a4-27a2cc2b88c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:40.878615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbf52-846a-4352-86a4-27a2cc2b88c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:40.879248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dbf52-846a-4352-86a4-27a2cc2b88c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:40.879552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dbf52-846a-4352-86a4-27a2cc2b88c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:40.881044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dbf52-846a-4352-86a4-27a2cc2b88c6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:40.894554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 526/1067] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:40.896636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6b416-eab4-44f9-af27-df68d99e23d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:40.898123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6b416-eab4-44f9-af27-df68d99e23d3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:40.901178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dbf52-846a-4352-86a4-27a2cc2b88c6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:40.910616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:41.009131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 542/1068] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:56:41.012035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dbf52-846a-4352-86a4-27a2cc2b88c6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:41.014923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6b416-eab4-44f9-af27-df68d99e23d3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:41.051676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86def9-da72-41d8-a0dc-5dc749e2c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:41.052353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86def9-da72-41d8-a0dc-5dc749e2c36c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:41.052658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86def9-da72-41d8-a0dc-5dc749e2c36c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:41.052941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86def9-da72-41d8-a0dc-5dc749e2c36c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:41.062726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86def9-da72-41d8-a0dc-5dc749e2c36c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:41.065018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86def9-da72-41d8-a0dc-5dc749e2c36c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2c86def9-da72-41d8-a0dc-5dc749e2c36c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:41.081300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:41.082329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:41.083282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 527/1069] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Aug 31 00:56:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:41.088801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86def9-da72-41d8-a0dc-5dc749e2c36c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:41.123064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6b416-eab4-44f9-af27-df68d99e23d3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:41.132356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:41.136527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:41.166108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3ec0d-2e82-4150-9340-97791f562892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:41.166743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3ec0d-2e82-4150-9340-97791f562892 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:41.167023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3ec0d-2e82-4150-9340-97791f562892 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:41.167301 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3ec0d-2e82-4150-9340-97791f562892 None admin] PATH_INFO: `/v3/projects/4fac8d9459974049b8f3488bddbcaec9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:41.168468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3ec0d-2e82-4150-9340-97791f562892 None admin] RBAC: Authorizing `identity:get_project(project_id=4fac8d9459974049b8f3488bddbcaec9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:41.169893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3ec0d-2e82-4150-9340-97791f562892 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:41.176843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 543/1070] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:56:41 2022] GET /identity/v3/projects/4fac8d9459974049b8f3488bddbcaec9 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:41.177513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3ec0d-2e82-4150-9340-97791f562892 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:41.210504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86def9-da72-41d8-a0dc-5dc749e2c36c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:41.246029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcb6a4-992e-4d5b-afa5-41c4feb0388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:41.246810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcb6a4-992e-4d5b-afa5-41c4feb0388d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:41.247103 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcb6a4-992e-4d5b-afa5-41c4feb0388d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:41.247383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcb6a4-992e-4d5b-afa5-41c4feb0388d None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:41.248131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcb6a4-992e-4d5b-afa5-41c4feb0388d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:41.248491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcb6a4-992e-4d5b-afa5-41c4feb0388d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:41.249933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcb6a4-992e-4d5b-afa5-41c4feb0388d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:41.268189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 528/1071] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Aug 31 00:56:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:41.274502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcb6a4-992e-4d5b-afa5-41c4feb0388d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:41.284174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3ec0d-2e82-4150-9340-97791f562892 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:41.320052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352e782-bdaf-44ca-a715-b27403635827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:41.320682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352e782-bdaf-44ca-a715-b27403635827 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:41.320964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352e782-bdaf-44ca-a715-b27403635827 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:41.321236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352e782-bdaf-44ca-a715-b27403635827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:41.321959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352e782-bdaf-44ca-a715-b27403635827 None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=4fac8d9459974049b8f3488bddbcaec9, user.id=f3a93805807a4c43ad53e7b3cc87c327) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:41.322271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352e782-bdaf-44ca-a715-b27403635827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:41.323700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352e782-bdaf-44ca-a715-b27403635827 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:41.329292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 544/1072] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:41 2022] GET /identity/v3/role_assignments?user.id=f3a93805807a4c43ad53e7b3cc87c327&scope.project.id=4fac8d9459974049b8f3488bddbcaec9&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:41.370091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:41.380729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcb6a4-992e-4d5b-afa5-41c4feb0388d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:41.420495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25298ff6-1d89-44bc-969e-0056c4ddc40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:41.421149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25298ff6-1d89-44bc-969e-0056c4ddc40d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:41.421431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25298ff6-1d89-44bc-969e-0056c4ddc40d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:41.421705 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25298ff6-1d89-44bc-969e-0056c4ddc40d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:41.433398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25298ff6-1d89-44bc-969e-0056c4ddc40d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:41.434965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25298ff6-1d89-44bc-969e-0056c4ddc40d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-25298ff6-1d89-44bc-969e-0056c4ddc40d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:41.451548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:41.452782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:41.453735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:41.453735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:41.453735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:41.453735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 529/1073] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:41.459111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352e782-bdaf-44ca-a715-b27403635827 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:41.508248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:41.573960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352e782-bdaf-44ca-a715-b27403635827 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:41.616067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eadfa-c0e7-4fac-a744-30f3bc90c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:41.617284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eadfa-c0e7-4fac-a744-30f3bc90c60e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:41.617284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eadfa-c0e7-4fac-a744-30f3bc90c60e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:41.617284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eadfa-c0e7-4fac-a744-30f3bc90c60e None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:41.617888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eadfa-c0e7-4fac-a744-30f3bc90c60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:41.618945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eadfa-c0e7-4fac-a744-30f3bc90c60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:41.625428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eadfa-c0e7-4fac-a744-30f3bc90c60e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:41.639049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 545/1074] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:41.644863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25298ff6-1d89-44bc-969e-0056c4ddc40d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:41.781013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25298ff6-1d89-44bc-969e-0056c4ddc40d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:41.819462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151294c2-6733-4dbe-8be5-cf1c2d031bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:41.820161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151294c2-6733-4dbe-8be5-cf1c2d031bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:41.820490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151294c2-6733-4dbe-8be5-cf1c2d031bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:41.820771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151294c2-6733-4dbe-8be5-cf1c2d031bf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:41.828874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151294c2-6733-4dbe-8be5-cf1c2d031bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:41.830348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151294c2-6733-4dbe-8be5-cf1c2d031bf6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-151294c2-6733-4dbe-8be5-cf1c2d031bf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:41.843547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:41.844591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:41.845508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:41.845508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:41.845508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:41.845508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:41.845508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:41.845508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:41.845508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:41.845508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:41.845508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 530/1075] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:41.851636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eadfa-c0e7-4fac-a744-30f3bc90c60e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:41.957729 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:41.961485 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eadfa-c0e7-4fac-a744-30f3bc90c60e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:42.001262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6031258-859c-4363-9d8d-5607b006dd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:42.001880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6031258-859c-4363-9d8d-5607b006dd58 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:42.002163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6031258-859c-4363-9d8d-5607b006dd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:42.002561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6031258-859c-4363-9d8d-5607b006dd58 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:42.003268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6031258-859c-4363-9d8d-5607b006dd58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:42.003578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6031258-859c-4363-9d8d-5607b006dd58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:42.005032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6031258-859c-4363-9d8d-5607b006dd58 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:42.016863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 546/1076] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:42.022981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151294c2-6733-4dbe-8be5-cf1c2d031bf6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:42.027761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:42.152295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151294c2-6733-4dbe-8be5-cf1c2d031bf6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:42.200044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99e7a9-5a33-46f3-a5b5-2d4cf2900f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:42.200753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99e7a9-5a33-46f3-a5b5-2d4cf2900f66 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:42.201039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99e7a9-5a33-46f3-a5b5-2d4cf2900f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:42.201319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99e7a9-5a33-46f3-a5b5-2d4cf2900f66 None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/a99d74d9d72c4fc2a363ce6559e4ddff/roles/e01ea2fe7de6460db138fffeaba5c894` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:42.203631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99e7a9-5a33-46f3-a5b5-2d4cf2900f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=a99d74d9d72c4fc2a363ce6559e4ddff, role_id=e01ea2fe7de6460db138fffeaba5c894)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:42.205146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99e7a9-5a33-46f3-a5b5-2d4cf2900f66 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:42.220413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 531/1077] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:56:42 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/a99d74d9d72c4fc2a363ce6559e4ddff/roles/e01ea2fe7de6460db138fffeaba5c894 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:56:43.400370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f13f6-d5e0-40a2-96a2-8c7486871b86 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:43.400892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f13f6-d5e0-40a2-96a2-8c7486871b86 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:43.400892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f13f6-d5e0-40a2-96a2-8c7486871b86 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:43.402210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 547/1078] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:43.407458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f677ba-9f05-453b-ac14-498b47b74161 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:43.407895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f677ba-9f05-453b-ac14-498b47b74161 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:43.408022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f677ba-9f05-453b-ac14-498b47b74161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:43.426777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-66f677ba-9f05-453b-ac14-498b47b74161 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:43.428743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-66f677ba-9f05-453b-ac14-498b47b74161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:43.487054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:43.497114 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 532/1079] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:43.784045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f13f6-d5e0-40a2-96a2-8c7486871b86 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:43.889696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f13f6-d5e0-40a2-96a2-8c7486871b86 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:43.923790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710304dd-8735-4eb0-af42-636ebccbc3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:43.924560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710304dd-8735-4eb0-af42-636ebccbc3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:43.924845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710304dd-8735-4eb0-af42-636ebccbc3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:43.925121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710304dd-8735-4eb0-af42-636ebccbc3d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:43.935566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710304dd-8735-4eb0-af42-636ebccbc3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-710304dd-8735-4eb0-af42-636ebccbc3d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:43.940294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:43.941334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:43.942243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 548/1080] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:56:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:43.948206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f677ba-9f05-453b-ac14-498b47b74161 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:44.046502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f677ba-9f05-453b-ac14-498b47b74161 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:44.080245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d713ad-6b67-455f-8f45-abf8fe5dfe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:44.080888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d713ad-6b67-455f-8f45-abf8fe5dfe1c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:44.081173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d713ad-6b67-455f-8f45-abf8fe5dfe1c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:44.081453 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d713ad-6b67-455f-8f45-abf8fe5dfe1c None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:44.082119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d713ad-6b67-455f-8f45-abf8fe5dfe1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:44.082429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d713ad-6b67-455f-8f45-abf8fe5dfe1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:44.083799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d713ad-6b67-455f-8f45-abf8fe5dfe1c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:44.092895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 533/1081] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:56:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:44.098722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710304dd-8735-4eb0-af42-636ebccbc3d2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:44.121047 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:44.142149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da11d-0b41-4a40-a7ac-bb63467e5e2a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:44.142457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da11d-0b41-4a40-a7ac-bb63467e5e2a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:44.142721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da11d-0b41-4a40-a7ac-bb63467e5e2a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:44.144058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 534/1082] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:56:44.150330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe794df-6622-4d9d-900f-e542dbabbaf1 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:44.150630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe794df-6622-4d9d-900f-e542dbabbaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:44.150916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe794df-6622-4d9d-900f-e542dbabbaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:44.169684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-abe794df-6622-4d9d-900f-e542dbabbaf1 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:44.170893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-abe794df-6622-4d9d-900f-e542dbabbaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:44.207661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710304dd-8735-4eb0-af42-636ebccbc3d2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:44.224205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:44.241954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 535/1083] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:44.243451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e15e86-aeef-428d-a52d-cf4c711e5644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:44.244091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e15e86-aeef-428d-a52d-cf4c711e5644 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:44.244409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e15e86-aeef-428d-a52d-cf4c711e5644 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:44.244784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e15e86-aeef-428d-a52d-cf4c711e5644 None admin] PATH_INFO: `/v3/users/f3a93805807a4c43ad53e7b3cc87c327` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:44.245937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e15e86-aeef-428d-a52d-cf4c711e5644 None admin] RBAC: Authorizing `identity:get_user(user_id=f3a93805807a4c43ad53e7b3cc87c327)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:44.247374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e15e86-aeef-428d-a52d-cf4c711e5644 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:44.253498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 549/1084] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:56:44 2022] GET /identity/v3/users/f3a93805807a4c43ad53e7b3cc87c327 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:44.254596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe794df-6622-4d9d-900f-e542dbabbaf1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:44.352901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe794df-6622-4d9d-900f-e542dbabbaf1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:44.388291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba4f2e-1ffd-4f38-9eca-5a5f10500b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:44.388945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba4f2e-1ffd-4f38-9eca-5a5f10500b6f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:44.389230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba4f2e-1ffd-4f38-9eca-5a5f10500b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:44.389506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba4f2e-1ffd-4f38-9eca-5a5f10500b6f None admin] PATH_INFO: `/v3/projects/4fac8d9459974049b8f3488bddbcaec9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:44.390628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba4f2e-1ffd-4f38-9eca-5a5f10500b6f None admin] RBAC: Authorizing `identity:get_project(project_id=4fac8d9459974049b8f3488bddbcaec9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:44.392064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba4f2e-1ffd-4f38-9eca-5a5f10500b6f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:44.393724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 536/1085] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:56:44 2022] GET /identity/v3/projects/4fac8d9459974049b8f3488bddbcaec9 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:44.400392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e15e86-aeef-428d-a52d-cf4c711e5644 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:44.486991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:44.499174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e15e86-aeef-428d-a52d-cf4c711e5644 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:44.512002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba4f2e-1ffd-4f38-9eca-5a5f10500b6f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:44.534170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db3478-56d3-462f-bd8e-c560469a00e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:44.534829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db3478-56d3-462f-bd8e-c560469a00e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:44.535108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db3478-56d3-462f-bd8e-c560469a00e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:44.535382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db3478-56d3-462f-bd8e-c560469a00e2 None admin] PATH_INFO: `/v3/projects/4fac8d9459974049b8f3488bddbcaec9/users/f3a93805807a4c43ad53e7b3cc87c327/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:44.537303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db3478-56d3-462f-bd8e-c560469a00e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fac8d9459974049b8f3488bddbcaec9, user_id=f3a93805807a4c43ad53e7b3cc87c327, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:44.539534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db3478-56d3-462f-bd8e-c560469a00e2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:44.552129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 550/1086] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:56:44 2022] PUT /identity/v3/projects/4fac8d9459974049b8f3488bddbcaec9/users/f3a93805807a4c43ad53e7b3cc87c327/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:56:44.574484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:44.626822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba4f2e-1ffd-4f38-9eca-5a5f10500b6f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:44.665069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489618f-3455-4d32-8b4f-c382cb5e1148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:44.665725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489618f-3455-4d32-8b4f-c382cb5e1148 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:44.666009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489618f-3455-4d32-8b4f-c382cb5e1148 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:44.666285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489618f-3455-4d32-8b4f-c382cb5e1148 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:44.678520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489618f-3455-4d32-8b4f-c382cb5e1148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-1489618f-3455-4d32-8b4f-c382cb5e1148 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:44.683407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:44.684577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:44.686074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 537/1087] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Aug 31 00:56:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:44.690675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db3478-56d3-462f-bd8e-c560469a00e2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:44.795389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db3478-56d3-462f-bd8e-c560469a00e2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:44.831692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2d85-6995-493f-951a-039b48e01c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:44.832303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2d85-6995-493f-951a-039b48e01c29 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:44.832604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2d85-6995-493f-951a-039b48e01c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:44.832878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2d85-6995-493f-951a-039b48e01c29 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:44.833536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c2d85-6995-493f-951a-039b48e01c29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:44.833838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c2d85-6995-493f-951a-039b48e01c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:44.835470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c2d85-6995-493f-951a-039b48e01c29 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:44.844072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 551/1088] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Aug 31 00:56:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:44.850306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489618f-3455-4d32-8b4f-c382cb5e1148 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:44.956627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489618f-3455-4d32-8b4f-c382cb5e1148 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:44.971483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:44.992717 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c5e5-70ac-4ccf-a1bb-a032d64beb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:44.993349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c5e5-70ac-4ccf-a1bb-a032d64beb65 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:44.993630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c5e5-70ac-4ccf-a1bb-a032d64beb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:44.993902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c5e5-70ac-4ccf-a1bb-a032d64beb65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:45.004789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035c5e5-70ac-4ccf-a1bb-a032d64beb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:45.006822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035c5e5-70ac-4ccf-a1bb-a032d64beb65 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0035c5e5-70ac-4ccf-a1bb-a032d64beb65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:45.021378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:45.022994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:45.023918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:45.023918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:45.023918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:45.023918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 538/1089] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:45.031077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2d85-6995-493f-951a-039b48e01c29 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:45.045249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:45.136548 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2d85-6995-493f-951a-039b48e01c29 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:45.171986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb2b82-6f4e-4c38-83a6-7e08b8dd6976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:45.172621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2b82-6f4e-4c38-83a6-7e08b8dd6976 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:45.172903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2b82-6f4e-4c38-83a6-7e08b8dd6976 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:45.173177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2b82-6f4e-4c38-83a6-7e08b8dd6976 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:45.173823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb2b82-6f4e-4c38-83a6-7e08b8dd6976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:45.174130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb2b82-6f4e-4c38-83a6-7e08b8dd6976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:45.175488 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb2b82-6f4e-4c38-83a6-7e08b8dd6976 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:45.187915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 552/1090] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:45.193518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c5e5-70ac-4ccf-a1bb-a032d64beb65 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:45.296161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c5e5-70ac-4ccf-a1bb-a032d64beb65 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:45.332438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd211e4-afe5-41fc-85f0-9fe428a4ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:45.333068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd211e4-afe5-41fc-85f0-9fe428a4ea39 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:45.333352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd211e4-afe5-41fc-85f0-9fe428a4ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:45.333628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd211e4-afe5-41fc-85f0-9fe428a4ea39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:45.341859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd211e4-afe5-41fc-85f0-9fe428a4ea39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:45.343298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd211e4-afe5-41fc-85f0-9fe428a4ea39 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-8bd211e4-afe5-41fc-85f0-9fe428a4ea39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:56:45.354637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:45.355604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:56:45.356745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 539/1091] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Aug 31 00:56:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:45.361628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb2b82-6f4e-4c38-83a6-7e08b8dd6976 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:45.431583 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:45.462969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb2b82-6f4e-4c38-83a6-7e08b8dd6976 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:45.497250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216e69-cfc8-4d3a-967c-6bece87d7896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:45.497865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216e69-cfc8-4d3a-967c-6bece87d7896 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:45.498148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216e69-cfc8-4d3a-967c-6bece87d7896 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:45.498426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216e69-cfc8-4d3a-967c-6bece87d7896 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:45.499153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3216e69-cfc8-4d3a-967c-6bece87d7896 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:45.499463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3216e69-cfc8-4d3a-967c-6bece87d7896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:45.500910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3216e69-cfc8-4d3a-967c-6bece87d7896 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:45.518562 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 553/1092] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Aug 31 00:56:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:45.525169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd211e4-afe5-41fc-85f0-9fe428a4ea39 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:45.553042 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:45.627748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd211e4-afe5-41fc-85f0-9fe428a4ea39 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:45.663835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ead9-e8e2-4a90-9852-92404f52d137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:45.664471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ead9-e8e2-4a90-9852-92404f52d137 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:45.664758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ead9-e8e2-4a90-9852-92404f52d137 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:45.665035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ead9-e8e2-4a90-9852-92404f52d137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:45.732707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9ead9-e8e2-4a90-9852-92404f52d137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:45.734147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9ead9-e8e2-4a90-9852-92404f52d137 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:45.761401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:45.835087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 540/1093] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:56:45.841256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216e69-cfc8-4d3a-967c-6bece87d7896 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:45.950214 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216e69-cfc8-4d3a-967c-6bece87d7896 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:45.984506 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:45.993613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab78e77-00f7-4865-b794-4b6024578000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:45.994250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab78e77-00f7-4865-b794-4b6024578000 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:45.994530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab78e77-00f7-4865-b794-4b6024578000 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:45.994805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab78e77-00f7-4865-b794-4b6024578000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:46.005469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab78e77-00f7-4865-b794-4b6024578000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:46.007488 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab78e77-00f7-4865-b794-4b6024578000 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9ab78e77-00f7-4865-b794-4b6024578000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:56:46.022113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:46.023096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:56:46.023989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:56:46.023989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:56:46.023989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:46.023989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 554/1094] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:46.029106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ead9-e8e2-4a90-9852-92404f52d137 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:46.129031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ead9-e8e2-4a90-9852-92404f52d137 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:46.156345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:46.166448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98806d-d466-4d40-9e52-5525a27814b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:46.167051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98806d-d466-4d40-9e52-5525a27814b1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:46.167338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98806d-d466-4d40-9e52-5525a27814b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:46.167614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98806d-d466-4d40-9e52-5525a27814b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:46.168285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98806d-d466-4d40-9e52-5525a27814b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:46.168616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98806d-d466-4d40-9e52-5525a27814b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:46.169988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98806d-d466-4d40-9e52-5525a27814b1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:46.182496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 541/1095] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:46.188083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab78e77-00f7-4865-b794-4b6024578000 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:46.289796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab78e77-00f7-4865-b794-4b6024578000 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:46.324026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bec378-4006-432b-bb52-da7045c484b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:46.324652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bec378-4006-432b-bb52-da7045c484b0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:46.324942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bec378-4006-432b-bb52-da7045c484b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:46.325206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bec378-4006-432b-bb52-da7045c484b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:46.332163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bec378-4006-432b-bb52-da7045c484b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:46.333668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bec378-4006-432b-bb52-da7045c484b0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a8bec378-4006-432b-bb52-da7045c484b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:56:46.345928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:46.347119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:46.348409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:56:46.348409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:56:46.348409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:56:46.348409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:56:46.348409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:56:46.348409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:56:46.348409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:56:46.348409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:46.352555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 555/1096] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:56:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:56:46.354184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98806d-d466-4d40-9e52-5525a27814b1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:46.460280 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98806d-d466-4d40-9e52-5525a27814b1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:46.491157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853631c-7d45-4494-ae1b-d4d2fc0074c3 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:46.491763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853631c-7d45-4494-ae1b-d4d2fc0074c3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:46.491763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853631c-7d45-4494-ae1b-d4d2fc0074c3 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:46.493331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 556/1097] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:46.497921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a396-83d8-467a-a33e-6cfbb6fc25eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:46.498546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a396-83d8-467a-a33e-6cfbb6fc25eb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:46.498705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79e785-b8cc-42e2-a66f-33c14da8223d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:46.498836 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a396-83d8-467a-a33e-6cfbb6fc25eb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:46.498993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79e785-b8cc-42e2-a66f-33c14da8223d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:46.499116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a396-83d8-467a-a33e-6cfbb6fc25eb None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:46.499269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79e785-b8cc-42e2-a66f-33c14da8223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:46.499831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075a396-83d8-467a-a33e-6cfbb6fc25eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:46.500145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075a396-83d8-467a-a33e-6cfbb6fc25eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:46.501615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075a396-83d8-467a-a33e-6cfbb6fc25eb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:46.515129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 542/1098] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:56:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:46.518274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-aa79e785-b8cc-42e2-a66f-33c14da8223d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:46.519480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-aa79e785-b8cc-42e2-a66f-33c14da8223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:46.521199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a396-83d8-467a-a33e-6cfbb6fc25eb None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:46.562381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:46.575672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:46.601057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 557/1099] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:56:46.635343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a396-83d8-467a-a33e-6cfbb6fc25eb None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:46.669996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912719-e8cd-47a1-9250-c4b9c02c0c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:46.670614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912719-e8cd-47a1-9250-c4b9c02c0c51 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:46.670899 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912719-e8cd-47a1-9250-c4b9c02c0c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:46.671179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912719-e8cd-47a1-9250-c4b9c02c0c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:46.671917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be912719-e8cd-47a1-9250-c4b9c02c0c51 None admin] RBAC: Adding query filter params (role.id=e01ea2fe7de6460db138fffeaba5c894, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=a99d74d9d72c4fc2a363ce6559e4ddff) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:46.672236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be912719-e8cd-47a1-9250-c4b9c02c0c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:46.673706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be912719-e8cd-47a1-9250-c4b9c02c0c51 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:46.680576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 543/1100] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:46 2022] GET /identity/v3/role_assignments?user.id=a99d74d9d72c4fc2a363ce6559e4ddff&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=e01ea2fe7de6460db138fffeaba5c894 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:56:46.885504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79e785-b8cc-42e2-a66f-33c14da8223d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:46.990588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79e785-b8cc-42e2-a66f-33c14da8223d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:47.026338 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7f88e-7235-45ef-9843-b0f5f705cc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:47.026972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7f88e-7235-45ef-9843-b0f5f705cc2b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:47.027249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7f88e-7235-45ef-9843-b0f5f705cc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:47.027528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7f88e-7235-45ef-9843-b0f5f705cc2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:47.038325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7f88e-7235-45ef-9843-b0f5f705cc2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f2e7f88e-7235-45ef-9843-b0f5f705cc2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:56:47.043062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:56:47.043997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:56:47.045065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 558/1101] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:56:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:56:47.050324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912719-e8cd-47a1-9250-c4b9c02c0c51 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:47.168176 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912719-e8cd-47a1-9250-c4b9c02c0c51 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:47.179171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:47.203734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4271a-d867-4b27-8d38-458fcc8a9373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:47.204368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4271a-d867-4b27-8d38-458fcc8a9373 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:47.204655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4271a-d867-4b27-8d38-458fcc8a9373 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:47.204930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4271a-d867-4b27-8d38-458fcc8a9373 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:47.205602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4271a-d867-4b27-8d38-458fcc8a9373 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:47.205903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4271a-d867-4b27-8d38-458fcc8a9373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:47.207273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4271a-d867-4b27-8d38-458fcc8a9373 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:47.217101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 544/1102] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:56:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:47.223128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7f88e-7235-45ef-9843-b0f5f705cc2b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:47.254061 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:47.332946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7f88e-7235-45ef-9843-b0f5f705cc2b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:47.370900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407242c2-a6f6-41aa-98bb-5cb55461c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:47.371544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407242c2-a6f6-41aa-98bb-5cb55461c98f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:47.371818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407242c2-a6f6-41aa-98bb-5cb55461c98f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:47.372088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407242c2-a6f6-41aa-98bb-5cb55461c98f None admin] PATH_INFO: `/v3/users/f3a93805807a4c43ad53e7b3cc87c327` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:47.373237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407242c2-a6f6-41aa-98bb-5cb55461c98f None admin] RBAC: Authorizing `identity:get_user(user_id=f3a93805807a4c43ad53e7b3cc87c327)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:47.374662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407242c2-a6f6-41aa-98bb-5cb55461c98f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:47.376258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 559/1103] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:56:47 2022] GET /identity/v3/users/f3a93805807a4c43ad53e7b3cc87c327 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:47.383462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4271a-d867-4b27-8d38-458fcc8a9373 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:47.499196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4271a-d867-4b27-8d38-458fcc8a9373 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:47.535517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b960c-fbe4-40e4-809e-1c0d6f2fcc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:47.536146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b960c-fbe4-40e4-809e-1c0d6f2fcc80 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:47.536469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b960c-fbe4-40e4-809e-1c0d6f2fcc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:47.536753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b960c-fbe4-40e4-809e-1c0d6f2fcc80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:47.580492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:47.607481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b960c-fbe4-40e4-809e-1c0d6f2fcc80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:47.608946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b960c-fbe4-40e4-809e-1c0d6f2fcc80 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:47.708720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 545/1104] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:56:47.714633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407242c2-a6f6-41aa-98bb-5cb55461c98f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:47.811148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:47.815075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407242c2-a6f6-41aa-98bb-5cb55461c98f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:47.848364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bc3c2-2680-465e-9bfb-a0ea15687b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:47.848991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc3c2-2680-465e-9bfb-a0ea15687b1a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:47.849272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc3c2-2680-465e-9bfb-a0ea15687b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:47.849546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc3c2-2680-465e-9bfb-a0ea15687b1a None admin] PATH_INFO: `/v3/projects/4fac8d9459974049b8f3488bddbcaec9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:47.851350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bc3c2-2680-465e-9bfb-a0ea15687b1a None admin] RBAC: Authorizing `identity:get_project(project_id=4fac8d9459974049b8f3488bddbcaec9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:47.852814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bc3c2-2680-465e-9bfb-a0ea15687b1a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:47.854502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 560/1105] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:56:47 2022] GET /identity/v3/projects/4fac8d9459974049b8f3488bddbcaec9 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:47.860595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b960c-fbe4-40e4-809e-1c0d6f2fcc80 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:47.929217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:47.958055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b960c-fbe4-40e4-809e-1c0d6f2fcc80 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:47.991523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271d0bf-db9f-4bf1-a274-d7d4945dea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:47.992123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d0bf-db9f-4bf1-a274-d7d4945dea45 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:47.992433 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d0bf-db9f-4bf1-a274-d7d4945dea45 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:47.992712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d0bf-db9f-4bf1-a274-d7d4945dea45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:47.993434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271d0bf-db9f-4bf1-a274-d7d4945dea45 None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=4fac8d9459974049b8f3488bddbcaec9, user.id=f3a93805807a4c43ad53e7b3cc87c327) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:47.993751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271d0bf-db9f-4bf1-a274-d7d4945dea45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:47.995178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271d0bf-db9f-4bf1-a274-d7d4945dea45 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:48.000823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 546/1106] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:47 2022] GET /identity/v3/role_assignments?user.id=f3a93805807a4c43ad53e7b3cc87c327&scope.project.id=4fac8d9459974049b8f3488bddbcaec9&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:49.937509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0f67-2a5b-49db-b12a-8e086e21182d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:49.938078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0f67-2a5b-49db-b12a-8e086e21182d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:49.938078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0f67-2a5b-49db-b12a-8e086e21182d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:49.939394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 561/1107] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:49.945161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fb1e-d584-4483-b8ab-40d067769eff None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:49.945671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fb1e-d584-4483-b8ab-40d067769eff None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:49.945767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fb1e-d584-4483-b8ab-40d067769eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:49.966311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-55f0fb1e-d584-4483-b8ab-40d067769eff None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:49.967506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-55f0fb1e-d584-4483-b8ab-40d067769eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:50.034463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 547/1108] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:50.301077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b0f67-2a5b-49db-b12a-8e086e21182d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:50.405953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b0f67-2a5b-49db-b12a-8e086e21182d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:50.441540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3057371-079c-43a7-abd7-a80b7547d04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:50.442171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3057371-079c-43a7-abd7-a80b7547d04b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:50.442448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3057371-079c-43a7-abd7-a80b7547d04b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:50.442718 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3057371-079c-43a7-abd7-a80b7547d04b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:50.443906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3057371-079c-43a7-abd7-a80b7547d04b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:50.445359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3057371-079c-43a7-abd7-a80b7547d04b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:50.446912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 562/1109] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:56:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:50.452816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fb1e-d584-4483-b8ab-40d067769eff None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:50.519456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:50.556781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fb1e-d584-4483-b8ab-40d067769eff None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:50.591175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c273055-5ada-4428-a289-31d34c4ee155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:50.591782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c273055-5ada-4428-a289-31d34c4ee155 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:50.592065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c273055-5ada-4428-a289-31d34c4ee155 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:50.592394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c273055-5ada-4428-a289-31d34c4ee155 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:50.593023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c273055-5ada-4428-a289-31d34c4ee155 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:50.594452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c273055-5ada-4428-a289-31d34c4ee155 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:50.616523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 548/1110] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:56:50 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:56:52.650668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715133b2-7ed9-4e9d-b4c0-4ec00e957c6c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:52.651197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715133b2-7ed9-4e9d-b4c0-4ec00e957c6c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:52.651289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715133b2-7ed9-4e9d-b4c0-4ec00e957c6c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:52.652604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 563/1111] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:52.657780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a786f-0854-4239-8716-0fafd02af3a1 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:52.658225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a786f-0854-4239-8716-0fafd02af3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:52.658320 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a786f-0854-4239-8716-0fafd02af3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:52.676999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-521a786f-0854-4239-8716-0fafd02af3a1 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:52.678993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-521a786f-0854-4239-8716-0fafd02af3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:52.749234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 549/1112] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:53.026366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715133b2-7ed9-4e9d-b4c0-4ec00e957c6c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:53.062523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:53.129907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715133b2-7ed9-4e9d-b4c0-4ec00e957c6c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:53.164334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42051c98-e927-488a-a0ca-26496ee351a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:53.164986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42051c98-e927-488a-a0ca-26496ee351a1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:53.165273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42051c98-e927-488a-a0ca-26496ee351a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:53.165552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42051c98-e927-488a-a0ca-26496ee351a1 None admin] PATH_INFO: `/v3/roles/5923fa436ead4ac4b096b40af8672f94` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:53.166997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42051c98-e927-488a-a0ca-26496ee351a1 None admin] RBAC: Authorizing `identity:get_role(role_id=5923fa436ead4ac4b096b40af8672f94)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:53.168394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42051c98-e927-488a-a0ca-26496ee351a1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:53.169733 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 564/1113] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:56:53 2022] GET /identity/v3/roles/5923fa436ead4ac4b096b40af8672f94 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:53.175547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a786f-0854-4239-8716-0fafd02af3a1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:53.228566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:53.278735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a786f-0854-4239-8716-0fafd02af3a1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:53.320660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6804c-3a85-4e02-9798-ed3dd990ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:53.321292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6804c-3a85-4e02-9798-ed3dd990ce18 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:53.321574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6804c-3a85-4e02-9798-ed3dd990ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:53.321847 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6804c-3a85-4e02-9798-ed3dd990ce18 None admin] PATH_INFO: `/v3/users/6b7ebd42c7084c7190620a4cb193b2ef` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:53.335232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6804c-3a85-4e02-9798-ed3dd990ce18 None admin] RBAC: Authorizing `identity:get_user(user_id=6b7ebd42c7084c7190620a4cb193b2ef)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:53.336700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6804c-3a85-4e02-9798-ed3dd990ce18 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:53.338302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 550/1114] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:56:53 2022] GET /identity/v3/users/6b7ebd42c7084c7190620a4cb193b2ef => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:53.344423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42051c98-e927-488a-a0ca-26496ee351a1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:53.442841 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42051c98-e927-488a-a0ca-26496ee351a1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:53.444643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:53.479027 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569eec1-4549-4fcc-bc2e-555bc272e902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:53.479628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569eec1-4549-4fcc-bc2e-555bc272e902 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:53.479906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569eec1-4549-4fcc-bc2e-555bc272e902 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:53.480180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569eec1-4549-4fcc-bc2e-555bc272e902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:53.551884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569eec1-4549-4fcc-bc2e-555bc272e902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:53.553414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569eec1-4549-4fcc-bc2e-555bc272e902 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:53.659372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 565/1115] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:56:53.666022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6804c-3a85-4e02-9798-ed3dd990ce18 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:53.766685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6804c-3a85-4e02-9798-ed3dd990ce18 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:53.778068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:53.801833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520129d-fb2d-4270-b1ba-74872f2216d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:53.802524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520129d-fb2d-4270-b1ba-74872f2216d0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:53.802757 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520129d-fb2d-4270-b1ba-74872f2216d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:53.803036 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520129d-fb2d-4270-b1ba-74872f2216d0 None admin] PATH_INFO: `/v3/projects/4fac8d9459974049b8f3488bddbcaec9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:53.804171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520129d-fb2d-4270-b1ba-74872f2216d0 None admin] RBAC: Authorizing `identity:get_project(project_id=4fac8d9459974049b8f3488bddbcaec9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:53.805635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520129d-fb2d-4270-b1ba-74872f2216d0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:53.807263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 551/1116] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:56:53 2022] GET /identity/v3/projects/4fac8d9459974049b8f3488bddbcaec9 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:53.813440 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569eec1-4549-4fcc-bc2e-555bc272e902 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:53.815595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:53.917275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569eec1-4549-4fcc-bc2e-555bc272e902 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:53.955651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9919fd-2cdd-4c1e-b2b1-62cadae16ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:53.956256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9919fd-2cdd-4c1e-b2b1-62cadae16ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:53.956569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9919fd-2cdd-4c1e-b2b1-62cadae16ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:53.956845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9919fd-2cdd-4c1e-b2b1-62cadae16ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:53.957573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9919fd-2cdd-4c1e-b2b1-62cadae16ab9 None admin] RBAC: Adding query filter params (role.id=5923fa436ead4ac4b096b40af8672f94, scope.project.id=4fac8d9459974049b8f3488bddbcaec9, user.id=6b7ebd42c7084c7190620a4cb193b2ef) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:56:53.957887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9919fd-2cdd-4c1e-b2b1-62cadae16ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:53.959884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9919fd-2cdd-4c1e-b2b1-62cadae16ab9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:53.966004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 566/1117] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:53 2022] GET /identity/v3/role_assignments?user.id=6b7ebd42c7084c7190620a4cb193b2ef&scope.project.id=4fac8d9459974049b8f3488bddbcaec9&role.id=5923fa436ead4ac4b096b40af8672f94 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:55.866806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d6e3b-2471-4fa9-8895-f1417bfdb279 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:55.867350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d6e3b-2471-4fa9-8895-f1417bfdb279 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:55.867445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d6e3b-2471-4fa9-8895-f1417bfdb279 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:55.868833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 552/1118] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:55.874326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c869aa-9a13-4fff-90a3-73cb50700455 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:55.874912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c869aa-9a13-4fff-90a3-73cb50700455 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:55.874912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c869aa-9a13-4fff-90a3-73cb50700455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:55.893260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c9c869aa-9a13-4fff-90a3-73cb50700455 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:55.894458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c9c869aa-9a13-4fff-90a3-73cb50700455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:55.953695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:55.962525 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 567/1119] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:56.238621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d6e3b-2471-4fa9-8895-f1417bfdb279 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:56.340960 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d6e3b-2471-4fa9-8895-f1417bfdb279 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:56.374901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157807e-eecc-426e-b0cb-5a1719e68ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:56.375519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157807e-eecc-426e-b0cb-5a1719e68ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:56.375804 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157807e-eecc-426e-b0cb-5a1719e68ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:56.376082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157807e-eecc-426e-b0cb-5a1719e68ff0 None admin] PATH_INFO: `/v3/roles/5923fa436ead4ac4b096b40af8672f94` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:56.377514 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157807e-eecc-426e-b0cb-5a1719e68ff0 None admin] RBAC: Authorizing `identity:get_role(role_id=5923fa436ead4ac4b096b40af8672f94)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:56.378892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157807e-eecc-426e-b0cb-5a1719e68ff0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:56.380216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 553/1120] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:56:56 2022] GET /identity/v3/roles/5923fa436ead4ac4b096b40af8672f94 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:56.386687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c869aa-9a13-4fff-90a3-73cb50700455 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:56.485138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c869aa-9a13-4fff-90a3-73cb50700455 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:56.518907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866ccce-5f49-481b-8fe6-cd5eb1df19d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:56.519541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866ccce-5f49-481b-8fe6-cd5eb1df19d7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:56.519819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866ccce-5f49-481b-8fe6-cd5eb1df19d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:56.520088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866ccce-5f49-481b-8fe6-cd5eb1df19d7 None admin] PATH_INFO: `/v3/users/6b7ebd42c7084c7190620a4cb193b2ef` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:56.521228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866ccce-5f49-481b-8fe6-cd5eb1df19d7 None admin] RBAC: Authorizing `identity:get_user(user_id=6b7ebd42c7084c7190620a4cb193b2ef)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:56.522705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866ccce-5f49-481b-8fe6-cd5eb1df19d7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:56.524270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 568/1121] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:56:56 2022] GET /identity/v3/users/6b7ebd42c7084c7190620a4cb193b2ef => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:56.530134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157807e-eecc-426e-b0cb-5a1719e68ff0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:56.577501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:56.630448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157807e-eecc-426e-b0cb-5a1719e68ff0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:56.665037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04b743-27e9-42d5-a86d-81f735f118c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:56.665672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b743-27e9-42d5-a86d-81f735f118c5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:56.665962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b743-27e9-42d5-a86d-81f735f118c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:56.666250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b743-27e9-42d5-a86d-81f735f118c5 None admin] PATH_INFO: `/v3/projects/4fac8d9459974049b8f3488bddbcaec9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:56.667382 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04b743-27e9-42d5-a86d-81f735f118c5 None admin] RBAC: Authorizing `identity:get_project(project_id=4fac8d9459974049b8f3488bddbcaec9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:56.668858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04b743-27e9-42d5-a86d-81f735f118c5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:56.670496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 554/1122] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:56:56 2022] GET /identity/v3/projects/4fac8d9459974049b8f3488bddbcaec9 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:56.676535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866ccce-5f49-481b-8fe6-cd5eb1df19d7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:56.741168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:56.778847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866ccce-5f49-481b-8fe6-cd5eb1df19d7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:56.813315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2597c3-6044-43e3-88ed-300fbdee684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:56.813978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2597c3-6044-43e3-88ed-300fbdee684c None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:56.814266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2597c3-6044-43e3-88ed-300fbdee684c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:56.814549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2597c3-6044-43e3-88ed-300fbdee684c None admin] PATH_INFO: `/v3/projects/4fac8d9459974049b8f3488bddbcaec9/users/6b7ebd42c7084c7190620a4cb193b2ef/roles/5923fa436ead4ac4b096b40af8672f94` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:56.816736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2597c3-6044-43e3-88ed-300fbdee684c None admin] RBAC: Authorizing `identity:create_grant(project_id=4fac8d9459974049b8f3488bddbcaec9, user_id=6b7ebd42c7084c7190620a4cb193b2ef, role_id=5923fa436ead4ac4b096b40af8672f94)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:56.818173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2597c3-6044-43e3-88ed-300fbdee684c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:56.831255 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 569/1123] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:56:56 2022] PUT /identity/v3/projects/4fac8d9459974049b8f3488bddbcaec9/users/6b7ebd42c7084c7190620a4cb193b2ef/roles/5923fa436ead4ac4b096b40af8672f94 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:56:58.763292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e09aba-9ba5-435a-b6b0-084c494c2cf5 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:58.763851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e09aba-9ba5-435a-b6b0-084c494c2cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:58.763851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e09aba-9ba5-435a-b6b0-084c494c2cf5 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:58.765211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 555/1124] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:56:58.770564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13922-b093-4922-8ebe-24da988b00a0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:58.770988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13922-b093-4922-8ebe-24da988b00a0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:58.771109 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13922-b093-4922-8ebe-24da988b00a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:58.789100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-afb13922-b093-4922-8ebe-24da988b00a0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:56:58.790269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-afb13922-b093-4922-8ebe-24da988b00a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:56:58.854372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 570/1125] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:56:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:59.131774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e09aba-9ba5-435a-b6b0-084c494c2cf5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:59.239515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e09aba-9ba5-435a-b6b0-084c494c2cf5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:59.256179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:59.277504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd86a-e8fc-4cf8-95f0-572ed8f82b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:59.278174 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd86a-e8fc-4cf8-95f0-572ed8f82b1e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:59.278452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd86a-e8fc-4cf8-95f0-572ed8f82b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:59.278724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd86a-e8fc-4cf8-95f0-572ed8f82b1e None admin] PATH_INFO: `/v3/roles/5923fa436ead4ac4b096b40af8672f94` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:59.280150 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebd86a-e8fc-4cf8-95f0-572ed8f82b1e None admin] RBAC: Authorizing `identity:get_role(role_id=5923fa436ead4ac4b096b40af8672f94)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:59.281555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebd86a-e8fc-4cf8-95f0-572ed8f82b1e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:59.282891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 556/1126] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:56:59 2022] GET /identity/v3/roles/5923fa436ead4ac4b096b40af8672f94 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:59.290295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb13922-b093-4922-8ebe-24da988b00a0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:59.356029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:59.409008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb13922-b093-4922-8ebe-24da988b00a0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:59.451721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3761e-e006-4d24-bede-1a4c19634565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:59.452391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3761e-e006-4d24-bede-1a4c19634565 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:59.452678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3761e-e006-4d24-bede-1a4c19634565 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:59.452962 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3761e-e006-4d24-bede-1a4c19634565 None admin] PATH_INFO: `/v3/users/6b7ebd42c7084c7190620a4cb193b2ef` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:59.454184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3761e-e006-4d24-bede-1a4c19634565 None admin] RBAC: Authorizing `identity:get_user(user_id=6b7ebd42c7084c7190620a4cb193b2ef)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:59.455633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3761e-e006-4d24-bede-1a4c19634565 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:59.457305 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 571/1127] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:56:59 2022] GET /identity/v3/users/6b7ebd42c7084c7190620a4cb193b2ef => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:59.463716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd86a-e8fc-4cf8-95f0-572ed8f82b1e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:59.570695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd86a-e8fc-4cf8-95f0-572ed8f82b1e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:59.607169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc9f0e-ebc3-406d-bb25-eb1095c3137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:59.607791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc9f0e-ebc3-406d-bb25-eb1095c3137e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:59.608072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc9f0e-ebc3-406d-bb25-eb1095c3137e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:59.608367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc9f0e-ebc3-406d-bb25-eb1095c3137e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:59.660858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:59.682649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc9f0e-ebc3-406d-bb25-eb1095c3137e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:59.684138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc9f0e-ebc3-406d-bb25-eb1095c3137e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:59.784642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 557/1128] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:56:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:56:59.791396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3761e-e006-4d24-bede-1a4c19634565 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:56:59.890219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3761e-e006-4d24-bede-1a4c19634565 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:56:59.915324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:59.927307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4fc40-49ee-4574-9bd5-61b2b76c1ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:56:59.928692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4fc40-49ee-4574-9bd5-61b2b76c1ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:56:59.928981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4fc40-49ee-4574-9bd5-61b2b76c1ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:56:59.929256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4fc40-49ee-4574-9bd5-61b2b76c1ea2 None admin] PATH_INFO: `/v3/projects/4fac8d9459974049b8f3488bddbcaec9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:56:59.930399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4fc40-49ee-4574-9bd5-61b2b76c1ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=4fac8d9459974049b8f3488bddbcaec9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:56:59.931846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4fc40-49ee-4574-9bd5-61b2b76c1ea2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:56:59.933533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 572/1129] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:56:59 2022] GET /identity/v3/projects/4fac8d9459974049b8f3488bddbcaec9 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:56:59.939664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc9f0e-ebc3-406d-bb25-eb1095c3137e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:00.024047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:00.043623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc9f0e-ebc3-406d-bb25-eb1095c3137e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:00.079172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f54b9-4c97-412a-abe7-99201c85d966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:00.079794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f54b9-4c97-412a-abe7-99201c85d966 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:00.080082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f54b9-4c97-412a-abe7-99201c85d966 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:00.080383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f54b9-4c97-412a-abe7-99201c85d966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:00.081132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f54b9-4c97-412a-abe7-99201c85d966 None admin] RBAC: Adding query filter params (role.id=5923fa436ead4ac4b096b40af8672f94, scope.project.id=4fac8d9459974049b8f3488bddbcaec9, user.id=6b7ebd42c7084c7190620a4cb193b2ef) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:00.081449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f54b9-4c97-412a-abe7-99201c85d966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:00.082921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f54b9-4c97-412a-abe7-99201c85d966 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:00.090028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 558/1130] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:56:59 2022] GET /identity/v3/role_assignments?user.id=6b7ebd42c7084c7190620a4cb193b2ef&scope.project.id=4fac8d9459974049b8f3488bddbcaec9&role.id=5923fa436ead4ac4b096b40af8672f94 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:02.065759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d46f1-e9dc-4c8a-823b-e4772e7ec6ef None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:02.066345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d46f1-e9dc-4c8a-823b-e4772e7ec6ef None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:02.066345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d46f1-e9dc-4c8a-823b-e4772e7ec6ef None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:02.067658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 573/1131] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:02.073759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698c7ae-8fc6-42ac-afd2-d4d4d4f76960 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:02.074260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698c7ae-8fc6-42ac-afd2-d4d4d4f76960 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:02.074378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698c7ae-8fc6-42ac-afd2-d4d4d4f76960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:02.094208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2698c7ae-8fc6-42ac-afd2-d4d4d4f76960 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:02.095502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2698c7ae-8fc6-42ac-afd2-d4d4d4f76960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:02.168875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 559/1132] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:57:02.442277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d46f1-e9dc-4c8a-823b-e4772e7ec6ef None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:02.546121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d46f1-e9dc-4c8a-823b-e4772e7ec6ef None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:02.581020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541d1d6-e343-4119-8d35-b0368568e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:02.581672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541d1d6-e343-4119-8d35-b0368568e676 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:02.581956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541d1d6-e343-4119-8d35-b0368568e676 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:02.582234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541d1d6-e343-4119-8d35-b0368568e676 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:02.583395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541d1d6-e343-4119-8d35-b0368568e676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:02.585368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541d1d6-e343-4119-8d35-b0368568e676 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:02.587026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 574/1133] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:57:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:02.593434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698c7ae-8fc6-42ac-afd2-d4d4d4f76960 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:02.676481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:02.700442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698c7ae-8fc6-42ac-afd2-d4d4d4f76960 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:02.735429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f36f9-f664-4132-8fc4-72389ac2c873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:02.736037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f36f9-f664-4132-8fc4-72389ac2c873 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:02.736346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f36f9-f664-4132-8fc4-72389ac2c873 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:02.736623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f36f9-f664-4132-8fc4-72389ac2c873 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:02.737291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f36f9-f664-4132-8fc4-72389ac2c873 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:02.738731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f36f9-f664-4132-8fc4-72389ac2c873 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:02.766001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 560/1134] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:57:02 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:57:04.734798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d14ae4-34f8-467d-8298-881abcf2c9e4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:04.735332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d14ae4-34f8-467d-8298-881abcf2c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:04.735332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d14ae4-34f8-467d-8298-881abcf2c9e4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:04.736732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 575/1135] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:04.741904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17c089-c9e1-463d-ab93-c52360e268af None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:04.742358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17c089-c9e1-463d-ab93-c52360e268af None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:04.742462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17c089-c9e1-463d-ab93-c52360e268af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:04.760878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2b17c089-c9e1-463d-ab93-c52360e268af None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:04.762063 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2b17c089-c9e1-463d-ab93-c52360e268af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:04.828554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 561/1136] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:57:05.102268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d14ae4-34f8-467d-8298-881abcf2c9e4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:05.161735 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:05.203627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d14ae4-34f8-467d-8298-881abcf2c9e4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:05.236914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c7707-5e09-474c-8c26-3c3607f5e677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:05.237530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7707-5e09-474c-8c26-3c3607f5e677 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:05.237814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7707-5e09-474c-8c26-3c3607f5e677 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:05.238086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7707-5e09-474c-8c26-3c3607f5e677 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:05.239161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c7707-5e09-474c-8c26-3c3607f5e677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:05.241310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c7707-5e09-474c-8c26-3c3607f5e677 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:05.242852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 576/1137] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:57:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:05.248627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17c089-c9e1-463d-ab93-c52360e268af None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:05.304537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:05.345533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17c089-c9e1-463d-ab93-c52360e268af None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:05.378785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede18ca-bebe-4416-8ac9-757297ce8bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:05.379324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede18ca-bebe-4416-8ac9-757297ce8bf0 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:05.379605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede18ca-bebe-4416-8ac9-757297ce8bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:05.379878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede18ca-bebe-4416-8ac9-757297ce8bf0 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:05.380547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede18ca-bebe-4416-8ac9-757297ce8bf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:05.382752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede18ca-bebe-4416-8ac9-757297ce8bf0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:05.403396 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 562/1138] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:57:05 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:57:07.369088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc70274-ea4e-414c-ae89-fa7da7c8fd5e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:07.369619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc70274-ea4e-414c-ae89-fa7da7c8fd5e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:07.369619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc70274-ea4e-414c-ae89-fa7da7c8fd5e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:07.370974 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 577/1139] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:07.376102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476efff9-a76c-4763-9653-957c46c2e280 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:07.376544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476efff9-a76c-4763-9653-957c46c2e280 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:07.376682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476efff9-a76c-4763-9653-957c46c2e280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:07.394603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-476efff9-a76c-4763-9653-957c46c2e280 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:07.395790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-476efff9-a76c-4763-9653-957c46c2e280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:07.460776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 563/1140] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:57:07.735819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc70274-ea4e-414c-ae89-fa7da7c8fd5e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:07.833988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc70274-ea4e-414c-ae89-fa7da7c8fd5e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:07.858635 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:07.867887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe36ed-b3ad-4d14-b082-0c31663dcc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:07.868537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe36ed-b3ad-4d14-b082-0c31663dcc95 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:07.868819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe36ed-b3ad-4d14-b082-0c31663dcc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:07.869094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe36ed-b3ad-4d14-b082-0c31663dcc95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:07.878676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe36ed-b3ad-4d14-b082-0c31663dcc95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-edbe36ed-b3ad-4d14-b082-0c31663dcc95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:57:07.884447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:57:07.888396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:57:07.889497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 578/1141] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:57:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:57:07.891481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476efff9-a76c-4763-9653-957c46c2e280 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:07.935265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:07.989634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476efff9-a76c-4763-9653-957c46c2e280 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:08.022213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bf5db-6fb2-47dc-aa6a-a1b6583a5b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:08.022806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf5db-6fb2-47dc-aa6a-a1b6583a5b30 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:08.023086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf5db-6fb2-47dc-aa6a-a1b6583a5b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:08.023359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf5db-6fb2-47dc-aa6a-a1b6583a5b30 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:08.024016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bf5db-6fb2-47dc-aa6a-a1b6583a5b30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:08.024318 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bf5db-6fb2-47dc-aa6a-a1b6583a5b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:08.025704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bf5db-6fb2-47dc-aa6a-a1b6583a5b30 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:08.033407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 564/1142] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:57:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:08.039811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe36ed-b3ad-4d14-b082-0c31663dcc95 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:08.136032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe36ed-b3ad-4d14-b082-0c31663dcc95 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:08.169188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2aaf-9ce7-4295-842e-66b9a88ffc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:08.169812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2aaf-9ce7-4295-842e-66b9a88ffc41 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:08.170098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2aaf-9ce7-4295-842e-66b9a88ffc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:08.170375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2aaf-9ce7-4295-842e-66b9a88ffc41 None admin] PATH_INFO: `/v3/users/0bfa63177db6451c812515024f9935d8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:08.183545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d2aaf-9ce7-4295-842e-66b9a88ffc41 None admin] RBAC: Authorizing `identity:get_user(user_id=0bfa63177db6451c812515024f9935d8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:08.185004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d2aaf-9ce7-4295-842e-66b9a88ffc41 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:08.186576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 579/1143] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:57:08 2022] GET /identity/v3/users/0bfa63177db6451c812515024f9935d8 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:08.192556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bf5db-6fb2-47dc-aa6a-a1b6583a5b30 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:08.290544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bf5db-6fb2-47dc-aa6a-a1b6583a5b30 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:08.297194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:08.324218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdde64-29a0-4081-b5f9-240fbb7e581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:08.324854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdde64-29a0-4081-b5f9-240fbb7e581f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:08.325139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdde64-29a0-4081-b5f9-240fbb7e581f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:08.325419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdde64-29a0-4081-b5f9-240fbb7e581f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:08.390229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdde64-29a0-4081-b5f9-240fbb7e581f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:08.391674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdde64-29a0-4081-b5f9-240fbb7e581f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:08.487049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 565/1144] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:57:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:57:08.493219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2aaf-9ce7-4295-842e-66b9a88ffc41 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:08.537695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:08.590989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2aaf-9ce7-4295-842e-66b9a88ffc41 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:08.628224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0cb3b-d47f-4d02-a14e-71e359b7fa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:08.628869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0cb3b-d47f-4d02-a14e-71e359b7fa0a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:08.629149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0cb3b-d47f-4d02-a14e-71e359b7fa0a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:08.629423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0cb3b-d47f-4d02-a14e-71e359b7fa0a None admin] PATH_INFO: `/v3/projects/7cc7a0720f084b2095551d5e0a6e23ec` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:08.630515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0cb3b-d47f-4d02-a14e-71e359b7fa0a None admin] RBAC: Authorizing `identity:get_project(project_id=7cc7a0720f084b2095551d5e0a6e23ec)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:08.635181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0cb3b-d47f-4d02-a14e-71e359b7fa0a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:08.636996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 580/1145] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:57:08 2022] GET /identity/v3/projects/7cc7a0720f084b2095551d5e0a6e23ec => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:08.644101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdde64-29a0-4081-b5f9-240fbb7e581f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:08.652707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:08.746998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdde64-29a0-4081-b5f9-240fbb7e581f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:08.779188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0811306-1101-4f8f-bbfb-dd7f2c882904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:08.779788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0811306-1101-4f8f-bbfb-dd7f2c882904 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:08.780072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0811306-1101-4f8f-bbfb-dd7f2c882904 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:08.780373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0811306-1101-4f8f-bbfb-dd7f2c882904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:08.781101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0811306-1101-4f8f-bbfb-dd7f2c882904 None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=7cc7a0720f084b2095551d5e0a6e23ec, user.id=0bfa63177db6451c812515024f9935d8) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:08.781416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0811306-1101-4f8f-bbfb-dd7f2c882904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:08.782842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0811306-1101-4f8f-bbfb-dd7f2c882904 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:08.788584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 566/1146] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:57:08 2022] GET /identity/v3/role_assignments?user.id=0bfa63177db6451c812515024f9935d8&scope.project.id=7cc7a0720f084b2095551d5e0a6e23ec&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:10.663414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3d6a5-7397-4278-9479-b84f824e5eb6 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:10.663958 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3d6a5-7397-4278-9479-b84f824e5eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:10.663958 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3d6a5-7397-4278-9479-b84f824e5eb6 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:10.665502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 581/1147] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:10.671028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cd7cd-0d65-4562-a0d6-0c4260ab7987 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:10.671448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cd7cd-0d65-4562-a0d6-0c4260ab7987 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:10.671595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cd7cd-0d65-4562-a0d6-0c4260ab7987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:10.689400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c18cd7cd-0d65-4562-a0d6-0c4260ab7987 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:10.690583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c18cd7cd-0d65-4562-a0d6-0c4260ab7987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:10.751610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:10.756390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 567/1148] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:57:11.028860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3d6a5-7397-4278-9479-b84f824e5eb6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:11.125411 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3d6a5-7397-4278-9479-b84f824e5eb6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:11.139378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:11.160963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192b274-1543-4b23-b10e-5725767825d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:11.161584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b274-1543-4b23-b10e-5725767825d4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:11.162479 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b274-1543-4b23-b10e-5725767825d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:11.162817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b274-1543-4b23-b10e-5725767825d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:11.172611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192b274-1543-4b23-b10e-5725767825d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-7192b274-1543-4b23-b10e-5725767825d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:57:11.177344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:57:11.179107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:57:11.180267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 582/1149] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:57:11.185071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cd7cd-0d65-4562-a0d6-0c4260ab7987 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:11.281096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cd7cd-0d65-4562-a0d6-0c4260ab7987 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:11.315051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a2dd-1dd9-4725-b1d7-ddb27e3e2367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:11.315659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a2dd-1dd9-4725-b1d7-ddb27e3e2367 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:11.315947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a2dd-1dd9-4725-b1d7-ddb27e3e2367 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:11.316229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a2dd-1dd9-4725-b1d7-ddb27e3e2367 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:11.316933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a2dd-1dd9-4725-b1d7-ddb27e3e2367 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:11.317245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a2dd-1dd9-4725-b1d7-ddb27e3e2367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:11.318646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a2dd-1dd9-4725-b1d7-ddb27e3e2367 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:11.326491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 568/1150] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:11.332420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192b274-1543-4b23-b10e-5725767825d4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:11.433038 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192b274-1543-4b23-b10e-5725767825d4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:11.465704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80249b2-82ce-44c2-90cd-a851fcc581f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:11.466319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80249b2-82ce-44c2-90cd-a851fcc581f1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:11.466626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80249b2-82ce-44c2-90cd-a851fcc581f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:11.466897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80249b2-82ce-44c2-90cd-a851fcc581f1 None admin] PATH_INFO: `/v3/users/0bfa63177db6451c812515024f9935d8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:11.467999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80249b2-82ce-44c2-90cd-a851fcc581f1 None admin] RBAC: Authorizing `identity:get_user(user_id=0bfa63177db6451c812515024f9935d8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:11.469499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80249b2-82ce-44c2-90cd-a851fcc581f1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:11.471049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 583/1151] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:57:11 2022] GET /identity/v3/users/0bfa63177db6451c812515024f9935d8 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:11.477390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a2dd-1dd9-4725-b1d7-ddb27e3e2367 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:11.537461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:11.575465 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a2dd-1dd9-4725-b1d7-ddb27e3e2367 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:11.608649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48966-f072-4691-86b9-9191cb6d9031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:11.609272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48966-f072-4691-86b9-9191cb6d9031 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:11.609554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48966-f072-4691-86b9-9191cb6d9031 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:11.609834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48966-f072-4691-86b9-9191cb6d9031 None admin] PATH_INFO: `/v3/projects/7cc7a0720f084b2095551d5e0a6e23ec` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:11.610929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48966-f072-4691-86b9-9191cb6d9031 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc7a0720f084b2095551d5e0a6e23ec)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:11.612365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48966-f072-4691-86b9-9191cb6d9031 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:11.613962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 569/1152] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:57:11 2022] GET /identity/v3/projects/7cc7a0720f084b2095551d5e0a6e23ec => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:57:11.619947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80249b2-82ce-44c2-90cd-a851fcc581f1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:11.660271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:11.717564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80249b2-82ce-44c2-90cd-a851fcc581f1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:11.750263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a1968-28dd-4050-9ded-1ad616aa66e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:11.750914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a1968-28dd-4050-9ded-1ad616aa66e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:11.751198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a1968-28dd-4050-9ded-1ad616aa66e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:11.751475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a1968-28dd-4050-9ded-1ad616aa66e2 None admin] PATH_INFO: `/v3/projects/7cc7a0720f084b2095551d5e0a6e23ec/users/0bfa63177db6451c812515024f9935d8/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:11.753365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a1968-28dd-4050-9ded-1ad616aa66e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc7a0720f084b2095551d5e0a6e23ec, user_id=0bfa63177db6451c812515024f9935d8, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:11.754794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a1968-28dd-4050-9ded-1ad616aa66e2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:11.767973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 584/1153] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:57:11 2022] PUT /identity/v3/projects/7cc7a0720f084b2095551d5e0a6e23ec/users/0bfa63177db6451c812515024f9935d8/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:57:13.620803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c067466-315e-4a2c-9427-34c953e922ea None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:13.621347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c067466-315e-4a2c-9427-34c953e922ea None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:13.621347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c067466-315e-4a2c-9427-34c953e922ea None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:13.622619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 570/1154] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:13.627866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99547a36-b69f-4b25-aef9-b5a2b6f3e1f4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:13.628261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99547a36-b69f-4b25-aef9-b5a2b6f3e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:13.628444 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99547a36-b69f-4b25-aef9-b5a2b6f3e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:13.647316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-99547a36-b69f-4b25-aef9-b5a2b6f3e1f4 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:13.648536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-99547a36-b69f-4b25-aef9-b5a2b6f3e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:13.714470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 585/1155] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:57:13.988269 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c067466-315e-4a2c-9427-34c953e922ea None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:14.088661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c067466-315e-4a2c-9427-34c953e922ea None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:14.117831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:14.124949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02361f0-c095-47f6-be7a-be329ca9b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:14.125618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02361f0-c095-47f6-be7a-be329ca9b03f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:14.125904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02361f0-c095-47f6-be7a-be329ca9b03f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:14.126180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02361f0-c095-47f6-be7a-be329ca9b03f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:14.137217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02361f0-c095-47f6-be7a-be329ca9b03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d02361f0-c095-47f6-be7a-be329ca9b03f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:57:14.141968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:57:14.143149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:57:14.144490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 571/1156] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:57:14.149809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99547a36-b69f-4b25-aef9-b5a2b6f3e1f4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:14.178156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:14.246920 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99547a36-b69f-4b25-aef9-b5a2b6f3e1f4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:14.280345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f281d-b616-4477-a499-30a4f09e935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:14.280963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f281d-b616-4477-a499-30a4f09e935a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:14.281246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f281d-b616-4477-a499-30a4f09e935a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:14.281524 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f281d-b616-4477-a499-30a4f09e935a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:14.282184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f281d-b616-4477-a499-30a4f09e935a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:14.282490 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f281d-b616-4477-a499-30a4f09e935a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:14.283856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f281d-b616-4477-a499-30a4f09e935a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:14.291824 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 586/1157] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:57:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:14.297799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02361f0-c095-47f6-be7a-be329ca9b03f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:14.404390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02361f0-c095-47f6-be7a-be329ca9b03f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:14.437783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09c86f-4a40-41e3-b850-33ee77a5c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:14.438408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09c86f-4a40-41e3-b850-33ee77a5c271 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:14.438695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09c86f-4a40-41e3-b850-33ee77a5c271 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:14.438975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09c86f-4a40-41e3-b850-33ee77a5c271 None admin] PATH_INFO: `/v3/users/0bfa63177db6451c812515024f9935d8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:14.440102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09c86f-4a40-41e3-b850-33ee77a5c271 None admin] RBAC: Authorizing `identity:get_user(user_id=0bfa63177db6451c812515024f9935d8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:14.441583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09c86f-4a40-41e3-b850-33ee77a5c271 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:14.443252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 572/1158] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:57:14 2022] GET /identity/v3/users/0bfa63177db6451c812515024f9935d8 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:14.449142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f281d-b616-4477-a499-30a4f09e935a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:14.539398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:14.547860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f281d-b616-4477-a499-30a4f09e935a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:14.580640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3270c18-c459-4569-9c36-163be6f58991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:14.581253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3270c18-c459-4569-9c36-163be6f58991 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:14.581532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3270c18-c459-4569-9c36-163be6f58991 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:14.581802 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3270c18-c459-4569-9c36-163be6f58991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:14.649109 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3270c18-c459-4569-9c36-163be6f58991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:14.650545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3270c18-c459-4569-9c36-163be6f58991 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:14.735614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:14.745101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 587/1159] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:57:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:57:14.751162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09c86f-4a40-41e3-b850-33ee77a5c271 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:14.808690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:14.850345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09c86f-4a40-41e3-b850-33ee77a5c271 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:14.885603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80094292-5ddf-40e3-8061-92c3a0673c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:14.886340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094292-5ddf-40e3-8061-92c3a0673c78 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:14.886531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094292-5ddf-40e3-8061-92c3a0673c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:14.886811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094292-5ddf-40e3-8061-92c3a0673c78 None admin] PATH_INFO: `/v3/projects/7cc7a0720f084b2095551d5e0a6e23ec` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:14.887935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80094292-5ddf-40e3-8061-92c3a0673c78 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc7a0720f084b2095551d5e0a6e23ec)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:14.889397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80094292-5ddf-40e3-8061-92c3a0673c78 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:14.891024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 573/1160] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:57:14 2022] GET /identity/v3/projects/7cc7a0720f084b2095551d5e0a6e23ec => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:14.897876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3270c18-c459-4569-9c36-163be6f58991 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:14.993527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3270c18-c459-4569-9c36-163be6f58991 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:15.027968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87200734-de6b-407d-b182-464c822efc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:15.028707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87200734-de6b-407d-b182-464c822efc73 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:15.028983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87200734-de6b-407d-b182-464c822efc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:15.029373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87200734-de6b-407d-b182-464c822efc73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:15.030157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87200734-de6b-407d-b182-464c822efc73 None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=7cc7a0720f084b2095551d5e0a6e23ec, user.id=0bfa63177db6451c812515024f9935d8) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:15.030157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87200734-de6b-407d-b182-464c822efc73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:15.031660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87200734-de6b-407d-b182-464c822efc73 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:15.037339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 588/1161] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:57:14 2022] GET /identity/v3/role_assignments?user.id=0bfa63177db6451c812515024f9935d8&scope.project.id=7cc7a0720f084b2095551d5e0a6e23ec&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:57:16.933016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdea68-c323-4512-a80c-b7f21f0ae1f7 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:16.933545 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdea68-c323-4512-a80c-b7f21f0ae1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:16.933669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdea68-c323-4512-a80c-b7f21f0ae1f7 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:16.935013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 574/1162] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:16.940492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510b2f-47dd-40d8-ac81-3194d2e76bd9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:16.940959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510b2f-47dd-40d8-ac81-3194d2e76bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:16.941122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510b2f-47dd-40d8-ac81-3194d2e76bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:16.961018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-16510b2f-47dd-40d8-ac81-3194d2e76bd9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:16.962182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-16510b2f-47dd-40d8-ac81-3194d2e76bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:17.011097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:17.027285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 589/1163] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:57:17.296706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bdea68-c323-4512-a80c-b7f21f0ae1f7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:17.396592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bdea68-c323-4512-a80c-b7f21f0ae1f7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:17.421640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:17.430525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1228e-e6a1-4f4c-b535-c2f1d42c5a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:17.431126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1228e-e6a1-4f4c-b535-c2f1d42c5a6c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:17.431408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1228e-e6a1-4f4c-b535-c2f1d42c5a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:17.431690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1228e-e6a1-4f4c-b535-c2f1d42c5a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:17.497115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1228e-e6a1-4f4c-b535-c2f1d42c5a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:17.498543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1228e-e6a1-4f4c-b535-c2f1d42c5a6c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:17.594300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 575/1164] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:57:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:57:17.600677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510b2f-47dd-40d8-ac81-3194d2e76bd9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:17.694458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510b2f-47dd-40d8-ac81-3194d2e76bd9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:17.727124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445ab75-a891-4ef2-985f-20c4f101a78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:17.727735 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ab75-a891-4ef2-985f-20c4f101a78d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:17.728013 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ab75-a891-4ef2-985f-20c4f101a78d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:17.728283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ab75-a891-4ef2-985f-20c4f101a78d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:17.734636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445ab75-a891-4ef2-985f-20c4f101a78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:17.736057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445ab75-a891-4ef2-985f-20c4f101a78d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6445ab75-a891-4ef2-985f-20c4f101a78d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:57:17.747001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:57:17.748239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:57:17.749339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 590/1165] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Aug 31 00:57:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:57:17.753894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1228e-e6a1-4f4c-b535-c2f1d42c5a6c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:17.781192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:17.854656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1228e-e6a1-4f4c-b535-c2f1d42c5a6c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:17.887704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64859010-6771-4e67-b1d7-69fb2fd1ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:17.888304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64859010-6771-4e67-b1d7-69fb2fd1ba71 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:17.888618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64859010-6771-4e67-b1d7-69fb2fd1ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:17.888896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64859010-6771-4e67-b1d7-69fb2fd1ba71 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:17.889533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64859010-6771-4e67-b1d7-69fb2fd1ba71 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:17.889840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64859010-6771-4e67-b1d7-69fb2fd1ba71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:17.891198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64859010-6771-4e67-b1d7-69fb2fd1ba71 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:17.898875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 576/1166] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Aug 31 00:57:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:19.794260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77183f70-3cb0-4630-b32b-ce87750c1743 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:19.794796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77183f70-3cb0-4630-b32b-ce87750c1743 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:19.794796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77183f70-3cb0-4630-b32b-ce87750c1743 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:19.796135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 591/1167] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:19.801361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c734-e99a-4623-8907-ef2bcd6aa312 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:19.801768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c734-e99a-4623-8907-ef2bcd6aa312 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:19.801927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c734-e99a-4623-8907-ef2bcd6aa312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:19.820931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a7b5c734-e99a-4623-8907-ef2bcd6aa312 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:19.822098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a7b5c734-e99a-4623-8907-ef2bcd6aa312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:19.886134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 577/1168] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:57:20.153169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77183f70-3cb0-4630-b32b-ce87750c1743 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:20.199903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:20.252251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77183f70-3cb0-4630-b32b-ce87750c1743 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:20.284665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184907bc-0b41-4fe5-b376-5e15f2f295c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:20.285287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184907bc-0b41-4fe5-b376-5e15f2f295c3 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:20.285570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184907bc-0b41-4fe5-b376-5e15f2f295c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:20.285846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184907bc-0b41-4fe5-b376-5e15f2f295c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:20.286508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184907bc-0b41-4fe5-b376-5e15f2f295c3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:20.288384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184907bc-0b41-4fe5-b376-5e15f2f295c3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:20.304090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 592/1169] 10.222.0.83 () {60 vars in 1138 bytes} [Wed Aug 31 00:57:20 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:57:22.238276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26ac7c-df05-4846-8045-a665ee27e145 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:22.238812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26ac7c-df05-4846-8045-a665ee27e145 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:22.238812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26ac7c-df05-4846-8045-a665ee27e145 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:22.240234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 578/1170] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:22.245577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd942b8-4d8d-4916-be3d-4971abd92dec None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:22.245953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd942b8-4d8d-4916-be3d-4971abd92dec None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:22.246179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd942b8-4d8d-4916-be3d-4971abd92dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:22.264625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6cd942b8-4d8d-4916-be3d-4971abd92dec None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:22.265804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6cd942b8-4d8d-4916-be3d-4971abd92dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:22.334736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 593/1171] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:57:22.606152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26ac7c-df05-4846-8045-a665ee27e145 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:22.631767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:22.717962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26ac7c-df05-4846-8045-a665ee27e145 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:22.750622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bd447-dffd-401c-8be5-3916c995bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:22.751244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd447-dffd-401c-8be5-3916c995bcea None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:22.751524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd447-dffd-401c-8be5-3916c995bcea None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:22.751795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd447-dffd-401c-8be5-3916c995bcea None admin] PATH_INFO: `/v3/domains/e0fe983d97da4380a2d3bc4d73e9c8a1` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:22.762698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bd447-dffd-401c-8be5-3916c995bcea None admin] RBAC: Authorizing `identity:get_domain(domain_id=e0fe983d97da4380a2d3bc4d73e9c8a1)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:22.764176 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bd447-dffd-401c-8be5-3916c995bcea None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:22.765777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 579/1172] 10.222.0.83 () {56 vars in 1183 bytes} [Wed Aug 31 00:57:22 2022] GET /identity/v3/domains/e0fe983d97da4380a2d3bc4d73e9c8a1 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:22.771814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd942b8-4d8d-4916-be3d-4971abd92dec None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:22.805211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:22.867381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd942b8-4d8d-4916-be3d-4971abd92dec None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:22.899438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e7dda-b4ee-427a-a9f6-6e984d4ad247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:22.900056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e7dda-b4ee-427a-a9f6-6e984d4ad247 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:22.900348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e7dda-b4ee-427a-a9f6-6e984d4ad247 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:22.900636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e7dda-b4ee-427a-a9f6-6e984d4ad247 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:22.901284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e7dda-b4ee-427a-a9f6-6e984d4ad247 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:22.902690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e7dda-b4ee-427a-a9f6-6e984d4ad247 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:22.929262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 594/1173] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:57:22 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:57:24.872792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936213d-9ec6-4dd4-8001-a5872201b491 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:24.873348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936213d-9ec6-4dd4-8001-a5872201b491 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:24.873348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936213d-9ec6-4dd4-8001-a5872201b491 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:24.874687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 580/1174] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:24.879787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a0ee1-597a-46b4-b819-85b63ae1d713 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:24.880194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a0ee1-597a-46b4-b819-85b63ae1d713 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:24.880437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a0ee1-597a-46b4-b819-85b63ae1d713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:24.899015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b09a0ee1-597a-46b4-b819-85b63ae1d713 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:24.900191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b09a0ee1-597a-46b4-b819-85b63ae1d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:24.964736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 595/1175] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:57:25.251152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936213d-9ec6-4dd4-8001-a5872201b491 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:25.331602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:25.352384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936213d-9ec6-4dd4-8001-a5872201b491 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:25.386333 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c8e3f-9840-4089-b5a8-7d34b9628a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:25.387584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c8e3f-9840-4089-b5a8-7d34b9628a8b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:25.387584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c8e3f-9840-4089-b5a8-7d34b9628a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:25.387584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c8e3f-9840-4089-b5a8-7d34b9628a8b None admin] PATH_INFO: `/v3/domains/e0fe983d97da4380a2d3bc4d73e9c8a1` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:25.388848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c8e3f-9840-4089-b5a8-7d34b9628a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=e0fe983d97da4380a2d3bc4d73e9c8a1)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:25.390310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c8e3f-9840-4089-b5a8-7d34b9628a8b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:25.392653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 581/1176] 10.222.0.83 () {56 vars in 1183 bytes} [Wed Aug 31 00:57:25 2022] GET /identity/v3/domains/e0fe983d97da4380a2d3bc4d73e9c8a1 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:25.399345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a0ee1-597a-46b4-b819-85b63ae1d713 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:25.417636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:25.497339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a0ee1-597a-46b4-b819-85b63ae1d713 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:25.530983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e2b55-9cd1-4ff4-a8f3-276606b41e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:25.531587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2b55-9cd1-4ff4-a8f3-276606b41e69 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:25.531871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2b55-9cd1-4ff4-a8f3-276606b41e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:25.532152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2b55-9cd1-4ff4-a8f3-276606b41e69 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:25.532826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e2b55-9cd1-4ff4-a8f3-276606b41e69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:25.534256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e2b55-9cd1-4ff4-a8f3-276606b41e69 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:25.555032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 596/1177] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:57:25 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:57:27.533053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eabeab-46a4-4f37-8d90-accbd1db30dc None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:27.533569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eabeab-46a4-4f37-8d90-accbd1db30dc None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:27.533569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eabeab-46a4-4f37-8d90-accbd1db30dc None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:27.534990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 582/1178] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:27.540297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9607ebe-c6db-4d23-b1b4-4f7fdb1dd5a3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:27.540755 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9607ebe-c6db-4d23-b1b4-4f7fdb1dd5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:27.540880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9607ebe-c6db-4d23-b1b4-4f7fdb1dd5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:27.558926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c9607ebe-c6db-4d23-b1b4-4f7fdb1dd5a3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:27.560106 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c9607ebe-c6db-4d23-b1b4-4f7fdb1dd5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:27.626028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 597/1179] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:57:27.892300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eabeab-46a4-4f37-8d90-accbd1db30dc None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:27.992648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eabeab-46a4-4f37-8d90-accbd1db30dc None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:28.029617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1126-88ff-4627-89d8-93675c6b062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:28.030243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1126-88ff-4627-89d8-93675c6b062b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:28.030528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1126-88ff-4627-89d8-93675c6b062b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:28.030802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1126-88ff-4627-89d8-93675c6b062b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:28.041501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1126-88ff-4627-89d8-93675c6b062b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-f04b1126-88ff-4627-89d8-93675c6b062b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:57:28.046237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:57:28.047310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:57:28.048180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 583/1180] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:57:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:57:28.054025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9607ebe-c6db-4d23-b1b4-4f7fdb1dd5a3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:28.057087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:28.152735 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9607ebe-c6db-4d23-b1b4-4f7fdb1dd5a3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:28.185772 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344143-3e9e-42f0-a35b-d4237a7a563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:28.186369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344143-3e9e-42f0-a35b-d4237a7a563a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:28.186647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344143-3e9e-42f0-a35b-d4237a7a563a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:28.186918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344143-3e9e-42f0-a35b-d4237a7a563a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:28.187570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32344143-3e9e-42f0-a35b-d4237a7a563a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:28.187871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32344143-3e9e-42f0-a35b-d4237a7a563a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:28.189250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32344143-3e9e-42f0-a35b-d4237a7a563a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:28.197018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 598/1181] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:28.202829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1126-88ff-4627-89d8-93675c6b062b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:28.214009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:28.304776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1126-88ff-4627-89d8-93675c6b062b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:28.337339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa04cac-39ec-4598-8dff-15df132f620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:28.337957 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa04cac-39ec-4598-8dff-15df132f620c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:28.338281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa04cac-39ec-4598-8dff-15df132f620c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:28.338521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa04cac-39ec-4598-8dff-15df132f620c None admin] PATH_INFO: `/v3/users/a6c43116d88a43abb0dc0ff4933fb600` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:28.351938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa04cac-39ec-4598-8dff-15df132f620c None admin] RBAC: Authorizing `identity:get_user(user_id=a6c43116d88a43abb0dc0ff4933fb600)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:28.353421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa04cac-39ec-4598-8dff-15df132f620c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:28.354994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 584/1182] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:57:28 2022] GET /identity/v3/users/a6c43116d88a43abb0dc0ff4933fb600 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:28.360939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344143-3e9e-42f0-a35b-d4237a7a563a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:28.423939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:28.457683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344143-3e9e-42f0-a35b-d4237a7a563a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:28.489941 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cfa15-3c27-40d5-9061-8254b32d1401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:28.490621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cfa15-3c27-40d5-9061-8254b32d1401 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:28.490899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cfa15-3c27-40d5-9061-8254b32d1401 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:28.491169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cfa15-3c27-40d5-9061-8254b32d1401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:28.555471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cfa15-3c27-40d5-9061-8254b32d1401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:28.556920 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cfa15-3c27-40d5-9061-8254b32d1401 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:28.617252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:28.651375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 599/1183] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:57:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:57:28.657363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa04cac-39ec-4598-8dff-15df132f620c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:28.722375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:28.757277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa04cac-39ec-4598-8dff-15df132f620c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:28.791974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29cb77-e78d-4a2d-b3ec-7d1dcff0568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:28.792656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29cb77-e78d-4a2d-b3ec-7d1dcff0568a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:28.792943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29cb77-e78d-4a2d-b3ec-7d1dcff0568a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:28.793223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29cb77-e78d-4a2d-b3ec-7d1dcff0568a None admin] PATH_INFO: `/v3/projects/bdd8a1254e09467bb24f6e9cb5247196` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:28.794346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29cb77-e78d-4a2d-b3ec-7d1dcff0568a None admin] RBAC: Authorizing `identity:get_project(project_id=bdd8a1254e09467bb24f6e9cb5247196)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:28.795783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29cb77-e78d-4a2d-b3ec-7d1dcff0568a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:28.797596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 585/1184] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:57:28 2022] GET /identity/v3/projects/bdd8a1254e09467bb24f6e9cb5247196 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:28.804141 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cfa15-3c27-40d5-9061-8254b32d1401 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:28.905933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cfa15-3c27-40d5-9061-8254b32d1401 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:28.939480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f0731-2c17-4cda-8614-961e9bb5dd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:28.940128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f0731-2c17-4cda-8614-961e9bb5dd92 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:28.940473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f0731-2c17-4cda-8614-961e9bb5dd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:28.940752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f0731-2c17-4cda-8614-961e9bb5dd92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:28.941467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f0731-2c17-4cda-8614-961e9bb5dd92 None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=bdd8a1254e09467bb24f6e9cb5247196, user.id=a6c43116d88a43abb0dc0ff4933fb600) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:28.941775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f0731-2c17-4cda-8614-961e9bb5dd92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:28.943799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f0731-2c17-4cda-8614-961e9bb5dd92 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:28.949541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 600/1185] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:57:28 2022] GET /identity/v3/role_assignments?user.id=a6c43116d88a43abb0dc0ff4933fb600&scope.project.id=bdd8a1254e09467bb24f6e9cb5247196&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:57:30.820942 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b782-571b-442f-a08b-339c8d8d9272 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:30.821499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b782-571b-442f-a08b-339c8d8d9272 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:30.821499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b782-571b-442f-a08b-339c8d8d9272 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:30.822894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 586/1186] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:30.828034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2caed-95dd-4e78-aa1b-e0c68d5d0b00 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:30.828503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2caed-95dd-4e78-aa1b-e0c68d5d0b00 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:30.828604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2caed-95dd-4e78-aa1b-e0c68d5d0b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:30.846831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ebd2caed-95dd-4e78-aa1b-e0c68d5d0b00 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:30.847997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ebd2caed-95dd-4e78-aa1b-e0c68d5d0b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:30.871457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:30.913125 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 601/1187] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:57:31.180111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b782-571b-442f-a08b-339c8d8d9272 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:31.278291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b782-571b-442f-a08b-339c8d8d9272 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:31.310962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a287-fa41-4929-8d49-705733ef66de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:31.311571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a287-fa41-4929-8d49-705733ef66de None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:31.311852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a287-fa41-4929-8d49-705733ef66de None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:31.312126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a287-fa41-4929-8d49-705733ef66de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:31.313944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:31.323511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20a287-fa41-4929-8d49-705733ef66de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4e20a287-fa41-4929-8d49-705733ef66de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:57:31.328195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:57:31.329156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:57:31.330022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 587/1188] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:57:31.335889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2caed-95dd-4e78-aa1b-e0c68d5d0b00 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:31.432344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2caed-95dd-4e78-aa1b-e0c68d5d0b00 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:31.465603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08f025-d7c7-4d44-b725-da44220bbbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:31.466205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08f025-d7c7-4d44-b725-da44220bbbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:31.466531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08f025-d7c7-4d44-b725-da44220bbbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:31.466763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08f025-d7c7-4d44-b725-da44220bbbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:31.467423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08f025-d7c7-4d44-b725-da44220bbbe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:31.467728 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08f025-d7c7-4d44-b725-da44220bbbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:31.469125 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08f025-d7c7-4d44-b725-da44220bbbe2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:31.477632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 602/1189] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:31.483381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a287-fa41-4929-8d49-705733ef66de None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:31.581534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a287-fa41-4929-8d49-705733ef66de None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:31.616235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37883e-3cd2-4bcb-9ba6-a57ac266990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:31.616953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37883e-3cd2-4bcb-9ba6-a57ac266990d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:31.617242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37883e-3cd2-4bcb-9ba6-a57ac266990d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:31.617518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37883e-3cd2-4bcb-9ba6-a57ac266990d None admin] PATH_INFO: `/v3/users/a6c43116d88a43abb0dc0ff4933fb600` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:31.618633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37883e-3cd2-4bcb-9ba6-a57ac266990d None admin] RBAC: Authorizing `identity:get_user(user_id=a6c43116d88a43abb0dc0ff4933fb600)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:31.620055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37883e-3cd2-4bcb-9ba6-a57ac266990d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:31.621643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 588/1190] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:57:31 2022] GET /identity/v3/users/a6c43116d88a43abb0dc0ff4933fb600 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:31.627459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08f025-d7c7-4d44-b725-da44220bbbe2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:31.652373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:31.725865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08f025-d7c7-4d44-b725-da44220bbbe2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:31.758779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55992616-cb7c-4571-abf4-95d5eaa17996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:31.759397 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55992616-cb7c-4571-abf4-95d5eaa17996 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:31.759682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55992616-cb7c-4571-abf4-95d5eaa17996 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:31.759958 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55992616-cb7c-4571-abf4-95d5eaa17996 None admin] PATH_INFO: `/v3/projects/bdd8a1254e09467bb24f6e9cb5247196` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:31.761092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55992616-cb7c-4571-abf4-95d5eaa17996 None admin] RBAC: Authorizing `identity:get_project(project_id=bdd8a1254e09467bb24f6e9cb5247196)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:31.762519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55992616-cb7c-4571-abf4-95d5eaa17996 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:31.764119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 603/1191] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:57:31 2022] GET /identity/v3/projects/bdd8a1254e09467bb24f6e9cb5247196 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:31.770014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37883e-3cd2-4bcb-9ba6-a57ac266990d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:31.829822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:31.868712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37883e-3cd2-4bcb-9ba6-a57ac266990d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:31.901418 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ba21d-6e8e-49b2-b614-54099ca5629c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:31.902059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ba21d-6e8e-49b2-b614-54099ca5629c None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:31.902342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ba21d-6e8e-49b2-b614-54099ca5629c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:31.902614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ba21d-6e8e-49b2-b614-54099ca5629c None admin] PATH_INFO: `/v3/projects/bdd8a1254e09467bb24f6e9cb5247196/users/a6c43116d88a43abb0dc0ff4933fb600/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:31.904839 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ba21d-6e8e-49b2-b614-54099ca5629c None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd8a1254e09467bb24f6e9cb5247196, user_id=a6c43116d88a43abb0dc0ff4933fb600, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:31.906255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ba21d-6e8e-49b2-b614-54099ca5629c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:31.918853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 589/1192] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:57:31 2022] PUT /identity/v3/projects/bdd8a1254e09467bb24f6e9cb5247196/users/a6c43116d88a43abb0dc0ff4933fb600/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:57:33.808558 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698a00-6173-4987-95c4-0003385161f1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:33.809085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698a00-6173-4987-95c4-0003385161f1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:33.809085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698a00-6173-4987-95c4-0003385161f1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:33.810439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 604/1193] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:57:33.815700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4065-f611-4bd1-9ca1-692fbbaa9734 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:33.816102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4065-f611-4bd1-9ca1-692fbbaa9734 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:33.816259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4065-f611-4bd1-9ca1-692fbbaa9734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:33.835102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0f6d4065-f611-4bd1-9ca1-692fbbaa9734 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:57:33.836276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0f6d4065-f611-4bd1-9ca1-692fbbaa9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:57:33.901840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 590/1194] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:57:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:57:34.168590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd698a00-6173-4987-95c4-0003385161f1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:34.257627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:34.268198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd698a00-6173-4987-95c4-0003385161f1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:34.300261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23f0c6-a751-4cf7-a2ba-4446b8fd0eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:34.300908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f0c6-a751-4cf7-a2ba-4446b8fd0eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:34.301191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f0c6-a751-4cf7-a2ba-4446b8fd0eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:34.301466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f0c6-a751-4cf7-a2ba-4446b8fd0eb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:34.312265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23f0c6-a751-4cf7-a2ba-4446b8fd0eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fa23f0c6-a751-4cf7-a2ba-4446b8fd0eb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:57:34.316988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:57:34.318187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:57:34.319381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 605/1195] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:57:34.324125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d4065-f611-4bd1-9ca1-692fbbaa9734 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:34.375015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:34.421662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d4065-f611-4bd1-9ca1-692fbbaa9734 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:34.454710 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a102c-4644-4a7b-9bb4-6891376c9a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:34.455311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a102c-4644-4a7b-9bb4-6891376c9a90 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:34.455597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a102c-4644-4a7b-9bb4-6891376c9a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:34.455873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a102c-4644-4a7b-9bb4-6891376c9a90 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:34.456563 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a102c-4644-4a7b-9bb4-6891376c9a90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:34.456873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a102c-4644-4a7b-9bb4-6891376c9a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:34.458276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a102c-4644-4a7b-9bb4-6891376c9a90 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:34.466461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 591/1196] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:34.472247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23f0c6-a751-4cf7-a2ba-4446b8fd0eb8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:34.569037 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23f0c6-a751-4cf7-a2ba-4446b8fd0eb8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:34.602124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66011cc-ee05-4372-91b5-5fef6fd7ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:34.602745 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66011cc-ee05-4372-91b5-5fef6fd7ef39 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:34.603029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66011cc-ee05-4372-91b5-5fef6fd7ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:34.603308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66011cc-ee05-4372-91b5-5fef6fd7ef39 None admin] PATH_INFO: `/v3/users/a6c43116d88a43abb0dc0ff4933fb600` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:34.604455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66011cc-ee05-4372-91b5-5fef6fd7ef39 None admin] RBAC: Authorizing `identity:get_user(user_id=a6c43116d88a43abb0dc0ff4933fb600)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:34.605881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66011cc-ee05-4372-91b5-5fef6fd7ef39 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:34.607428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 606/1197] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Aug 31 00:57:34 2022] GET /identity/v3/users/a6c43116d88a43abb0dc0ff4933fb600 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:34.613325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a102c-4644-4a7b-9bb4-6891376c9a90 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:34.719184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a102c-4644-4a7b-9bb4-6891376c9a90 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:34.732271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:34.752669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b615c-7bb4-4e1a-b91b-42609c5017de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:34.754548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b615c-7bb4-4e1a-b91b-42609c5017de None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:34.754832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b615c-7bb4-4e1a-b91b-42609c5017de None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:34.755694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b615c-7bb4-4e1a-b91b-42609c5017de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:34.820094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b615c-7bb4-4e1a-b91b-42609c5017de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:34.821563 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b615c-7bb4-4e1a-b91b-42609c5017de None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:34.916104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 592/1198] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:57:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:57:34.922189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66011cc-ee05-4372-91b5-5fef6fd7ef39 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:34.941633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:35.021558 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66011cc-ee05-4372-91b5-5fef6fd7ef39 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:35.054557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7911d15-a0d7-49c0-a15f-18929aae01bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:35.055172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7911d15-a0d7-49c0-a15f-18929aae01bf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:35.055452 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7911d15-a0d7-49c0-a15f-18929aae01bf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:35.055723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7911d15-a0d7-49c0-a15f-18929aae01bf None admin] PATH_INFO: `/v3/projects/bdd8a1254e09467bb24f6e9cb5247196` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:35.056839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7911d15-a0d7-49c0-a15f-18929aae01bf None admin] RBAC: Authorizing `identity:get_project(project_id=bdd8a1254e09467bb24f6e9cb5247196)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:35.058255 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7911d15-a0d7-49c0-a15f-18929aae01bf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:35.059857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 607/1199] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Aug 31 00:57:34 2022] GET /identity/v3/projects/bdd8a1254e09467bb24f6e9cb5247196 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:35.066122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b615c-7bb4-4e1a-b91b-42609c5017de None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:57:35.080793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:35.168254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b615c-7bb4-4e1a-b91b-42609c5017de None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:57:35.201793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cb521-eba8-4fbd-ba78-9f717fc93c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:57:35.202398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cb521-eba8-4fbd-ba78-9f717fc93c5f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:57:35.202685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cb521-eba8-4fbd-ba78-9f717fc93c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:57:35.202962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cb521-eba8-4fbd-ba78-9f717fc93c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:57:35.203683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cb521-eba8-4fbd-ba78-9f717fc93c5f None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=bdd8a1254e09467bb24f6e9cb5247196, user.id=a6c43116d88a43abb0dc0ff4933fb600) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:57:35.203995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cb521-eba8-4fbd-ba78-9f717fc93c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:57:35.205456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cb521-eba8-4fbd-ba78-9f717fc93c5f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:57:35.211096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 593/1200] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:57:35 2022] GET /identity/v3/role_assignments?user.id=a6c43116d88a43abb0dc0ff4933fb600&scope.project.id=bdd8a1254e09467bb24f6e9cb5247196&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:57:45.049836 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=57 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:45.209055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=61 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:30.792968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ef53a-9d5c-4cd3-af0e-314ce8f569c6 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:30.792968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ef53a-9d5c-4cd3-af0e-314ce8f569c6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:30.792968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ef53a-9d5c-4cd3-af0e-314ce8f569c6 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:30.792968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 608/1201] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:58:30.799271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363191d-cffb-47d5-aa14-66087fd195c4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:30.799786 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363191d-cffb-47d5-aa14-66087fd195c4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:30.799873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363191d-cffb-47d5-aa14-66087fd195c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:30.822560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3363191d-cffb-47d5-aa14-66087fd195c4 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:58:30.823771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3363191d-cffb-47d5-aa14-66087fd195c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:58:30.924693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 594/1202] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:58:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:58:31.240071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ef53a-9d5c-4cd3-af0e-314ce8f569c6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:31.376559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ef53a-9d5c-4cd3-af0e-314ce8f569c6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:31.417652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71f4b0-70be-4944-a820-2242d0027f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:31.418437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f4b0-70be-4944-a820-2242d0027f3c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:31.418723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f4b0-70be-4944-a820-2242d0027f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:31.419146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f4b0-70be-4944-a820-2242d0027f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:31.433911 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71f4b0-70be-4944-a820-2242d0027f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:31.435542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71f4b0-70be-4944-a820-2242d0027f3c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1f71f4b0-70be-4944-a820-2242d0027f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:31.458414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:31.459771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:31.460842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:31.460842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:31.460842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:31.460842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 609/1203] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:58:31.466393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363191d-cffb-47d5-aa14-66087fd195c4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:31.602624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363191d-cffb-47d5-aa14-66087fd195c4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:31.640606 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:31.648898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17862e25-890f-46f7-8f5a-e21a37ae0007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:31.649541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17862e25-890f-46f7-8f5a-e21a37ae0007 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:31.649828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17862e25-890f-46f7-8f5a-e21a37ae0007 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:31.650182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17862e25-890f-46f7-8f5a-e21a37ae0007 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:31.650764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17862e25-890f-46f7-8f5a-e21a37ae0007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:31.651115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17862e25-890f-46f7-8f5a-e21a37ae0007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:31.652509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17862e25-890f-46f7-8f5a-e21a37ae0007 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:31.669014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 595/1204] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:31.674868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71f4b0-70be-4944-a820-2242d0027f3c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:31.748156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:31.808398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71f4b0-70be-4944-a820-2242d0027f3c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:31.854383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db937ab-8806-4011-b515-50e34c39cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:31.854942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db937ab-8806-4011-b515-50e34c39cc86 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:31.855232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db937ab-8806-4011-b515-50e34c39cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:31.855504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db937ab-8806-4011-b515-50e34c39cc86 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:31.856184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db937ab-8806-4011-b515-50e34c39cc86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:31.857767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db937ab-8806-4011-b515-50e34c39cc86 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:31.887967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 610/1205] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Aug 31 00:58:31 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:58:34.095857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4e75a-8be1-461a-8ef9-feb1b4b6c860 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:34.096443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4e75a-8be1-461a-8ef9-feb1b4b6c860 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:34.096443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4e75a-8be1-461a-8ef9-feb1b4b6c860 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:34.098696 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 596/1206] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:58:34.104730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ffb04-21b3-4fe7-a187-9aa799b37796 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:34.105188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ffb04-21b3-4fe7-a187-9aa799b37796 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:34.105298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ffb04-21b3-4fe7-a187-9aa799b37796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:34.125934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-491ffb04-21b3-4fe7-a187-9aa799b37796 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:58:34.127472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-491ffb04-21b3-4fe7-a187-9aa799b37796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:58:34.213204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 611/1207] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:58:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:58:34.526720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4e75a-8be1-461a-8ef9-feb1b4b6c860 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:34.668406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4e75a-8be1-461a-8ef9-feb1b4b6c860 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:34.712633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e6612-c3c6-4070-bb98-3ed670f09f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:34.713281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e6612-c3c6-4070-bb98-3ed670f09f47 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:34.713572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e6612-c3c6-4070-bb98-3ed670f09f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:34.713852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e6612-c3c6-4070-bb98-3ed670f09f47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:34.726295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e6612-c3c6-4070-bb98-3ed670f09f47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0a6e6612-c3c6-4070-bb98-3ed670f09f47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:58:34.731394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:34.732421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:34.733278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 597/1208] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:58:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:34.739779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ffb04-21b3-4fe7-a187-9aa799b37796 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:34.786945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:34.851417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ffb04-21b3-4fe7-a187-9aa799b37796 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:34.887683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797204a1-4293-48c3-a2b2-af389eeebc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:34.888370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797204a1-4293-48c3-a2b2-af389eeebc43 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:34.888613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797204a1-4293-48c3-a2b2-af389eeebc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:34.888895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797204a1-4293-48c3-a2b2-af389eeebc43 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:34.889564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797204a1-4293-48c3-a2b2-af389eeebc43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:34.889873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797204a1-4293-48c3-a2b2-af389eeebc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:34.891247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797204a1-4293-48c3-a2b2-af389eeebc43 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:34.900370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 612/1209] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:58:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:58:34.905733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e6612-c3c6-4070-bb98-3ed670f09f47 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:34.967954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:35.028339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e6612-c3c6-4070-bb98-3ed670f09f47 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:35.071251 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f0396-8132-4585-aa90-49def2006327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:35.071802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f0396-8132-4585-aa90-49def2006327 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:35.072087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f0396-8132-4585-aa90-49def2006327 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:35.072511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f0396-8132-4585-aa90-49def2006327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:35.083913 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f0396-8132-4585-aa90-49def2006327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:35.085437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f0396-8132-4585-aa90-49def2006327 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b89f0396-8132-4585-aa90-49def2006327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:35.101041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:35.102812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:35.103761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:35.103761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:35.103761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:35.103761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 598/1210] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:58:35.108443 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797204a1-4293-48c3-a2b2-af389eeebc43 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:35.226347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:35.231579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797204a1-4293-48c3-a2b2-af389eeebc43 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:35.271434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eff880-1a83-436c-b722-fa17f1248b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:35.272266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eff880-1a83-436c-b722-fa17f1248b43 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:35.272735 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eff880-1a83-436c-b722-fa17f1248b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:35.273125 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eff880-1a83-436c-b722-fa17f1248b43 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:35.273824 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eff880-1a83-436c-b722-fa17f1248b43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:35.274217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eff880-1a83-436c-b722-fa17f1248b43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:35.275688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eff880-1a83-436c-b722-fa17f1248b43 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:35.291514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 613/1211] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:58:35.295170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f0396-8132-4585-aa90-49def2006327 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:35.418162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f0396-8132-4585-aa90-49def2006327 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:35.420374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:35.459713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f0b2f-dc34-41a0-8f88-05b1d50234c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:35.460423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0b2f-dc34-41a0-8f88-05b1d50234c0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:35.460795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0b2f-dc34-41a0-8f88-05b1d50234c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:35.461140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0b2f-dc34-41a0-8f88-05b1d50234c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:35.470483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f0b2f-dc34-41a0-8f88-05b1d50234c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:35.472255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f0b2f-dc34-41a0-8f88-05b1d50234c0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ad5f0b2f-dc34-41a0-8f88-05b1d50234c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:58:35.485929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:35.492010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:35.493133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 599/1212] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:35.493740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eff880-1a83-436c-b722-fa17f1248b43 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:35.621508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eff880-1a83-436c-b722-fa17f1248b43 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:35.664750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd2e3a-b3bd-4caa-a84a-986dc42d1b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:35.665651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd2e3a-b3bd-4caa-a84a-986dc42d1b96 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:35.666106 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd2e3a-b3bd-4caa-a84a-986dc42d1b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:35.666571 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd2e3a-b3bd-4caa-a84a-986dc42d1b96 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:35.667318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd2e3a-b3bd-4caa-a84a-986dc42d1b96 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:35.667613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd2e3a-b3bd-4caa-a84a-986dc42d1b96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:35.669199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd2e3a-b3bd-4caa-a84a-986dc42d1b96 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:35.689840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 614/1213] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Aug 31 00:58:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:35.696353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f0b2f-dc34-41a0-8f88-05b1d50234c0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:35.835659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f0b2f-dc34-41a0-8f88-05b1d50234c0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:35.880267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333ae6f-e5dd-407f-ae71-a10d8bba533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:35.880967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333ae6f-e5dd-407f-ae71-a10d8bba533f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:35.881230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333ae6f-e5dd-407f-ae71-a10d8bba533f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:35.881503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333ae6f-e5dd-407f-ae71-a10d8bba533f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:35.920527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:35.969233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333ae6f-e5dd-407f-ae71-a10d8bba533f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:35.970693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333ae6f-e5dd-407f-ae71-a10d8bba533f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:36.088193 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 600/1214] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:58:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:58:36.094307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd2e3a-b3bd-4caa-a84a-986dc42d1b96 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:36.116675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:36.222898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd2e3a-b3bd-4caa-a84a-986dc42d1b96 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:36.262653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33933b23-77ea-4161-a951-fb6d0f8a4256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:36.263333 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33933b23-77ea-4161-a951-fb6d0f8a4256 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:36.263619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33933b23-77ea-4161-a951-fb6d0f8a4256 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:36.263996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33933b23-77ea-4161-a951-fb6d0f8a4256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:36.280856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33933b23-77ea-4161-a951-fb6d0f8a4256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:36.282540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33933b23-77ea-4161-a951-fb6d0f8a4256 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-33933b23-77ea-4161-a951-fb6d0f8a4256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:36.312317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:36.314313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:36.324628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:36.324628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:36.324628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:36.324628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 615/1215] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:36.324923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333ae6f-e5dd-407f-ae71-a10d8bba533f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:36.388623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:36.430880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333ae6f-e5dd-407f-ae71-a10d8bba533f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:36.466585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c1ad-28d3-4ead-90a6-905140805045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:36.467194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c1ad-28d3-4ead-90a6-905140805045 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:36.467475 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c1ad-28d3-4ead-90a6-905140805045 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:36.467746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c1ad-28d3-4ead-90a6-905140805045 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:36.468448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358c1ad-28d3-4ead-90a6-905140805045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:36.468766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358c1ad-28d3-4ead-90a6-905140805045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:36.470120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358c1ad-28d3-4ead-90a6-905140805045 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:36.482917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 601/1216] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:36.488437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33933b23-77ea-4161-a951-fb6d0f8a4256 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:36.565578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:36.601491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33933b23-77ea-4161-a951-fb6d0f8a4256 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:36.656869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8cc5f-cb3a-41ed-b366-7835b6dea367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:36.657553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8cc5f-cb3a-41ed-b366-7835b6dea367 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:36.657838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8cc5f-cb3a-41ed-b366-7835b6dea367 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:36.658151 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8cc5f-cb3a-41ed-b366-7835b6dea367 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:36.666676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8cc5f-cb3a-41ed-b366-7835b6dea367 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:36.668209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8cc5f-cb3a-41ed-b366-7835b6dea367 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-14f8cc5f-cb3a-41ed-b366-7835b6dea367 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:58:36.681152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:36.682170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:36.683087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:58:36.683087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:58:36.683087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:58:36.683087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:58:36.683087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:58:36.683087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:58:36.683087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:36.683087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:36.683087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 616/1217] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:36.689531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c1ad-28d3-4ead-90a6-905140805045 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:36.812456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c1ad-28d3-4ead-90a6-905140805045 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:36.837296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:36.852403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4d365-d20f-40aa-ba54-61e8b7e69c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:36.853031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d365-d20f-40aa-ba54-61e8b7e69c4b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:36.853316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d365-d20f-40aa-ba54-61e8b7e69c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:36.853621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d365-d20f-40aa-ba54-61e8b7e69c4b None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:36.854297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4d365-d20f-40aa-ba54-61e8b7e69c4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:36.854612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4d365-d20f-40aa-ba54-61e8b7e69c4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:36.856420 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4d365-d20f-40aa-ba54-61e8b7e69c4b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:36.870679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 602/1218] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:36.876869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8cc5f-cb3a-41ed-b366-7835b6dea367 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:37.000112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8cc5f-cb3a-41ed-b366-7835b6dea367 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:37.033034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:37.039923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435d081-2d98-4d5f-85b5-074bf84630f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:37.040669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435d081-2d98-4d5f-85b5-074bf84630f8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:37.041024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435d081-2d98-4d5f-85b5-074bf84630f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:37.041341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435d081-2d98-4d5f-85b5-074bf84630f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:37.042154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435d081-2d98-4d5f-85b5-074bf84630f8 None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=1eb93baf45174c10a6fcbe321ac65764) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:37.042473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435d081-2d98-4d5f-85b5-074bf84630f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:37.044176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435d081-2d98-4d5f-85b5-074bf84630f8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:37.050002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 617/1219] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:58:36 2022] GET /identity/v3/role_assignments?user.id=1eb93baf45174c10a6fcbe321ac65764&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:39.129697 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158bf1-0b12-45a6-aa42-f51ca7724154 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:39.130282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158bf1-0b12-45a6-aa42-f51ca7724154 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:39.130442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158bf1-0b12-45a6-aa42-f51ca7724154 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:39.132027 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 603/1220] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:58:39.137573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb203e3-d433-4d92-8f1f-9e0cf81f5d1b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:39.138046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb203e3-d433-4d92-8f1f-9e0cf81f5d1b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:39.138252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb203e3-d433-4d92-8f1f-9e0cf81f5d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:39.158096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cdb203e3-d433-4d92-8f1f-9e0cf81f5d1b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:58:39.159420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cdb203e3-d433-4d92-8f1f-9e0cf81f5d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:58:39.230820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 618/1221] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:58:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:58:39.508683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09158bf1-0b12-45a6-aa42-f51ca7724154 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:39.621972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09158bf1-0b12-45a6-aa42-f51ca7724154 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:39.670123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1a2af-d13b-42a1-b0ea-4fd5e3924dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:39.670760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1a2af-d13b-42a1-b0ea-4fd5e3924dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:39.671042 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1a2af-d13b-42a1-b0ea-4fd5e3924dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:39.671319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1a2af-d13b-42a1-b0ea-4fd5e3924dd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:39.682296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1a2af-d13b-42a1-b0ea-4fd5e3924dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d7e1a2af-d13b-42a1-b0ea-4fd5e3924dd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:58:39.687277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:39.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:39.689179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 604/1222] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:58:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:39.694635 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb203e3-d433-4d92-8f1f-9e0cf81f5d1b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:39.798878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb203e3-d433-4d92-8f1f-9e0cf81f5d1b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:39.823784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:39.836317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ee1c7-a6a8-451f-b76c-76d67debdf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:39.836959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ee1c7-a6a8-451f-b76c-76d67debdf49 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:39.837243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ee1c7-a6a8-451f-b76c-76d67debdf49 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:39.837521 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ee1c7-a6a8-451f-b76c-76d67debdf49 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:39.838189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ee1c7-a6a8-451f-b76c-76d67debdf49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:39.838497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ee1c7-a6a8-451f-b76c-76d67debdf49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:39.840114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ee1c7-a6a8-451f-b76c-76d67debdf49 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:39.848771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 619/1223] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:58:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:39.854705 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1a2af-d13b-42a1-b0ea-4fd5e3924dd8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:39.899781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:39.959636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1a2af-d13b-42a1-b0ea-4fd5e3924dd8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:39.997720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fe696-01e0-4839-a04c-142e7c7ca655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:39.998359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fe696-01e0-4839-a04c-142e7c7ca655 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:39.998644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fe696-01e0-4839-a04c-142e7c7ca655 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:39.998920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fe696-01e0-4839-a04c-142e7c7ca655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:40.009683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fe696-01e0-4839-a04c-142e7c7ca655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:40.011341 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fe696-01e0-4839-a04c-142e7c7ca655 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-292fe696-01e0-4839-a04c-142e7c7ca655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:40.027117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:40.028492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:40.029621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:40.029621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:40.029621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:40.029621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 605/1224] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:40.034265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ee1c7-a6a8-451f-b76c-76d67debdf49 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:40.148951 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ee1c7-a6a8-451f-b76c-76d67debdf49 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:40.186919 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800cdec-b13b-418b-99f1-0f52e804e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:40.187587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800cdec-b13b-418b-99f1-0f52e804e919 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:40.187869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800cdec-b13b-418b-99f1-0f52e804e919 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:40.188216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800cdec-b13b-418b-99f1-0f52e804e919 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:40.188971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800cdec-b13b-418b-99f1-0f52e804e919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:40.189317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800cdec-b13b-418b-99f1-0f52e804e919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:40.190720 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800cdec-b13b-418b-99f1-0f52e804e919 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:40.203605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 620/1225] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:40.210357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fe696-01e0-4839-a04c-142e7c7ca655 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:40.312611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:40.320162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fe696-01e0-4839-a04c-142e7c7ca655 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:40.356937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acd6be-9f2c-4ce5-8f55-e2f475f411aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:40.357573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd6be-9f2c-4ce5-8f55-e2f475f411aa None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:40.357858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd6be-9f2c-4ce5-8f55-e2f475f411aa None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:40.358134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd6be-9f2c-4ce5-8f55-e2f475f411aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:40.366605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acd6be-9f2c-4ce5-8f55-e2f475f411aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:40.368095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acd6be-9f2c-4ce5-8f55-e2f475f411aa None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-59acd6be-9f2c-4ce5-8f55-e2f475f411aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:58:40.380177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:40.381527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:40.382734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 606/1226] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:40.387266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800cdec-b13b-418b-99f1-0f52e804e919 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:40.439251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:40.500361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800cdec-b13b-418b-99f1-0f52e804e919 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:40.540604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316a07-a15e-442f-9aba-f8fa2c0ac61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:40.541274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316a07-a15e-442f-9aba-f8fa2c0ac61e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:40.541557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316a07-a15e-442f-9aba-f8fa2c0ac61e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:40.541831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316a07-a15e-442f-9aba-f8fa2c0ac61e None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:40.542632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86316a07-a15e-442f-9aba-f8fa2c0ac61e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:40.542998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86316a07-a15e-442f-9aba-f8fa2c0ac61e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:40.544597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86316a07-a15e-442f-9aba-f8fa2c0ac61e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:40.563563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 621/1227] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Aug 31 00:58:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:40.570147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acd6be-9f2c-4ce5-8f55-e2f475f411aa None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:40.686376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acd6be-9f2c-4ce5-8f55-e2f475f411aa None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:40.722040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0d1b7-3912-48d3-924d-b6415bb30332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:40.722597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0d1b7-3912-48d3-924d-b6415bb30332 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:40.723541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0d1b7-3912-48d3-924d-b6415bb30332 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:40.723890 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0d1b7-3912-48d3-924d-b6415bb30332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:40.734807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0d1b7-3912-48d3-924d-b6415bb30332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:40.736266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0d1b7-3912-48d3-924d-b6415bb30332 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-69f0d1b7-3912-48d3-924d-b6415bb30332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:40.751219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:40.752243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:40.753788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:40.753788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:40.753788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:40.753788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 607/1228] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:58:40.758816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316a07-a15e-442f-9aba-f8fa2c0ac61e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:40.859241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316a07-a15e-442f-9aba-f8fa2c0ac61e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:40.863876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:40.899075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699559f-8a0c-4c33-aefb-cc37e01ae436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:40.899733 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699559f-8a0c-4c33-aefb-cc37e01ae436 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:40.900063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699559f-8a0c-4c33-aefb-cc37e01ae436 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:40.900299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699559f-8a0c-4c33-aefb-cc37e01ae436 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:40.900996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699559f-8a0c-4c33-aefb-cc37e01ae436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:40.901345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699559f-8a0c-4c33-aefb-cc37e01ae436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:40.902771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699559f-8a0c-4c33-aefb-cc37e01ae436 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:40.919490 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 622/1229] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:40.920647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0d1b7-3912-48d3-924d-b6415bb30332 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:40.931322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:41.035000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0d1b7-3912-48d3-924d-b6415bb30332 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:41.075043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8307d0-a709-4578-805b-fd8ea8ab8626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:41.075681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8307d0-a709-4578-805b-fd8ea8ab8626 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:41.075959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8307d0-a709-4578-805b-fd8ea8ab8626 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:41.076293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8307d0-a709-4578-805b-fd8ea8ab8626 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:41.083890 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8307d0-a709-4578-805b-fd8ea8ab8626 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:41.085608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8307d0-a709-4578-805b-fd8ea8ab8626 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-6b8307d0-a709-4578-805b-fd8ea8ab8626 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:58:41.097838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:41.098921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:41.099991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:58:41.099991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:58:41.099991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:58:41.099991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:58:41.099991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:58:41.099991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:58:41.099991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:41.099991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:41.103700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 608/1230] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:58:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:41.104827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699559f-8a0c-4c33-aefb-cc37e01ae436 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:41.212504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699559f-8a0c-4c33-aefb-cc37e01ae436 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:41.247484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44316c0d-a8a4-47f6-a5b1-9852497a2b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:41.248075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316c0d-a8a4-47f6-a5b1-9852497a2b1d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:41.248455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316c0d-a8a4-47f6-a5b1-9852497a2b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:41.248635 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316c0d-a8a4-47f6-a5b1-9852497a2b1d None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:41.249314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44316c0d-a8a4-47f6-a5b1-9852497a2b1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:41.249621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44316c0d-a8a4-47f6-a5b1-9852497a2b1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:41.251040 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44316c0d-a8a4-47f6-a5b1-9852497a2b1d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:41.265073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 623/1231] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:58:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:41.271850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8307d0-a709-4578-805b-fd8ea8ab8626 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:41.352265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:41.388562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8307d0-a709-4578-805b-fd8ea8ab8626 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:41.423562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dc660-9961-40ad-bff7-dd560554335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:41.424280 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc660-9961-40ad-bff7-dd560554335e None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:41.424615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc660-9961-40ad-bff7-dd560554335e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:41.424928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc660-9961-40ad-bff7-dd560554335e None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/1eb93baf45174c10a6fcbe321ac65764/roles/7953b234543143eab052272480b952ec` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:41.441516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dc660-9961-40ad-bff7-dd560554335e None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=1eb93baf45174c10a6fcbe321ac65764, role_id=7953b234543143eab052272480b952ec)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:41.443938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dc660-9961-40ad-bff7-dd560554335e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:41.456959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 609/1232] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:58:41 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/1eb93baf45174c10a6fcbe321ac65764/roles/7953b234543143eab052272480b952ec => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:58:43.553905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2840b-716d-4a9e-92ea-f79dfde0e80e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:43.554427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2840b-716d-4a9e-92ea-f79dfde0e80e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:43.554427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2840b-716d-4a9e-92ea-f79dfde0e80e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:43.555708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 624/1233] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:58:43.561379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595929b-fdf8-4216-a913-ca96fd160498 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:43.561878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595929b-fdf8-4216-a913-ca96fd160498 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:43.562086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595929b-fdf8-4216-a913-ca96fd160498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:43.581558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d595929b-fdf8-4216-a913-ca96fd160498 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:58:43.582787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d595929b-fdf8-4216-a913-ca96fd160498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:58:43.659191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 610/1234] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:58:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:58:43.929091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2840b-716d-4a9e-92ea-f79dfde0e80e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:43.955935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:44.042928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2840b-716d-4a9e-92ea-f79dfde0e80e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:44.083117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c2956-2f57-43d6-bd88-a3f76d710f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:44.083907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2956-2f57-43d6-bd88-a3f76d710f2c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:44.084191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2956-2f57-43d6-bd88-a3f76d710f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:44.084496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2956-2f57-43d6-bd88-a3f76d710f2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:44.097205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c2956-2f57-43d6-bd88-a3f76d710f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a40c2956-2f57-43d6-bd88-a3f76d710f2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:58:44.103182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:44.104136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:44.105742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 625/1235] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Aug 31 00:58:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:44.111706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595929b-fdf8-4216-a913-ca96fd160498 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:44.166486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:44.224481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595929b-fdf8-4216-a913-ca96fd160498 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:44.262567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc235a2-d6f5-49d9-bc42-8f36abf9fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:44.263230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc235a2-d6f5-49d9-bc42-8f36abf9fd55 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:44.263545 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc235a2-d6f5-49d9-bc42-8f36abf9fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:44.263756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc235a2-d6f5-49d9-bc42-8f36abf9fd55 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:44.264473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc235a2-d6f5-49d9-bc42-8f36abf9fd55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:44.264807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc235a2-d6f5-49d9-bc42-8f36abf9fd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:44.266168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc235a2-d6f5-49d9-bc42-8f36abf9fd55 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:44.275879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 611/1236] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Aug 31 00:58:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:44.281722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c2956-2f57-43d6-bd88-a3f76d710f2c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:44.372376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:44.390415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c2956-2f57-43d6-bd88-a3f76d710f2c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:44.427657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14ba84-ab68-40fc-a519-ffc0c0fe0599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:44.428267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14ba84-ab68-40fc-a519-ffc0c0fe0599 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:44.428576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14ba84-ab68-40fc-a519-ffc0c0fe0599 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:44.428874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14ba84-ab68-40fc-a519-ffc0c0fe0599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:44.439259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14ba84-ab68-40fc-a519-ffc0c0fe0599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:44.440751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14ba84-ab68-40fc-a519-ffc0c0fe0599 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1b14ba84-ab68-40fc-a519-ffc0c0fe0599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:44.457854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:44.459424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:44.461023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:44.461023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:44.461023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:44.463074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 626/1237] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:58:44.469306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc235a2-d6f5-49d9-bc42-8f36abf9fd55 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:44.591097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc235a2-d6f5-49d9-bc42-8f36abf9fd55 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:44.602501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:44.639136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3bb03-1c42-4150-bd69-47e99d0b938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:44.639997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3bb03-1c42-4150-bd69-47e99d0b938a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:44.640287 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3bb03-1c42-4150-bd69-47e99d0b938a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:44.640599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3bb03-1c42-4150-bd69-47e99d0b938a None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:44.641546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3bb03-1c42-4150-bd69-47e99d0b938a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:44.642002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3bb03-1c42-4150-bd69-47e99d0b938a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:44.644527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3bb03-1c42-4150-bd69-47e99d0b938a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:44.662796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 612/1238] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:58:44.670157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14ba84-ab68-40fc-a519-ffc0c0fe0599 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:44.791149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14ba84-ab68-40fc-a519-ffc0c0fe0599 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:44.830291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bf2d7-f711-4ab6-8333-3cbea41fbc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:44.830913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bf2d7-f711-4ab6-8333-3cbea41fbc44 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:44.831192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bf2d7-f711-4ab6-8333-3cbea41fbc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:44.831475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bf2d7-f711-4ab6-8333-3cbea41fbc44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:44.834346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:44.840891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bf2d7-f711-4ab6-8333-3cbea41fbc44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:44.842532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bf2d7-f711-4ab6-8333-3cbea41fbc44 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-567bf2d7-f711-4ab6-8333-3cbea41fbc44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:58:44.857045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:44.858211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:44.859219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 627/1239] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:44.865625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3bb03-1c42-4150-bd69-47e99d0b938a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:44.990318 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3bb03-1c42-4150-bd69-47e99d0b938a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:45.033745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61694a6c-c046-47ed-ba82-6aff9c423663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:45.034536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694a6c-c046-47ed-ba82-6aff9c423663 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:45.035034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694a6c-c046-47ed-ba82-6aff9c423663 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:45.035370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694a6c-c046-47ed-ba82-6aff9c423663 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:45.036237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61694a6c-c046-47ed-ba82-6aff9c423663 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:45.036581 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61694a6c-c046-47ed-ba82-6aff9c423663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:45.038082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61694a6c-c046-47ed-ba82-6aff9c423663 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:45.060072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 613/1240] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Aug 31 00:58:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:45.066265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bf2d7-f711-4ab6-8333-3cbea41fbc44 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:45.187972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bf2d7-f711-4ab6-8333-3cbea41fbc44 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:45.229429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78cbd8-d2c2-4659-b9d9-14fdda7012b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:45.230046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78cbd8-d2c2-4659-b9d9-14fdda7012b4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:45.230326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78cbd8-d2c2-4659-b9d9-14fdda7012b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:45.230637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78cbd8-d2c2-4659-b9d9-14fdda7012b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:45.305864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:45.315453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78cbd8-d2c2-4659-b9d9-14fdda7012b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:45.317242 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78cbd8-d2c2-4659-b9d9-14fdda7012b4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:45.432430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 628/1241] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:58:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:58:45.435970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61694a6c-c046-47ed-ba82-6aff9c423663 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:45.470206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:45.546572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61694a6c-c046-47ed-ba82-6aff9c423663 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:45.582099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237b098-7a56-4772-94dc-a6ea476510f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:45.583270 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237b098-7a56-4772-94dc-a6ea476510f2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:45.583549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237b098-7a56-4772-94dc-a6ea476510f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:45.583825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237b098-7a56-4772-94dc-a6ea476510f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:45.593709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237b098-7a56-4772-94dc-a6ea476510f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:45.595146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237b098-7a56-4772-94dc-a6ea476510f2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4237b098-7a56-4772-94dc-a6ea476510f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:45.612241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:45.613811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:45.615021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:45.615021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:45.615021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:45.615021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 614/1242] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:45.620470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78cbd8-d2c2-4659-b9d9-14fdda7012b4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:45.734219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:45.740763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78cbd8-d2c2-4659-b9d9-14fdda7012b4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:45.778791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac193070-9a0b-4a3b-bd34-d2bec4dda4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:45.779570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac193070-9a0b-4a3b-bd34-d2bec4dda4ca None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:45.779852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac193070-9a0b-4a3b-bd34-d2bec4dda4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:45.780130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac193070-9a0b-4a3b-bd34-d2bec4dda4ca None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:45.780834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac193070-9a0b-4a3b-bd34-d2bec4dda4ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:45.781215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac193070-9a0b-4a3b-bd34-d2bec4dda4ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:45.782789 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac193070-9a0b-4a3b-bd34-d2bec4dda4ca None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:45.794869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 629/1243] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:45.801532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237b098-7a56-4772-94dc-a6ea476510f2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:45.890033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:45.915029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237b098-7a56-4772-94dc-a6ea476510f2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:45.952071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f639a-b28d-4811-a2d5-3b512d33aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:45.952832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f639a-b28d-4811-a2d5-3b512d33aba6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:45.953194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f639a-b28d-4811-a2d5-3b512d33aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:45.953554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f639a-b28d-4811-a2d5-3b512d33aba6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:45.961197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f639a-b28d-4811-a2d5-3b512d33aba6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:45.962873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f639a-b28d-4811-a2d5-3b512d33aba6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-493f639a-b28d-4811-a2d5-3b512d33aba6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:58:45.976171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:45.982033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:45.983245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:58:45.983245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:58:45.983245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:58:45.983245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:58:45.983245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:58:45.983245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:58:45.983245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:45.983245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:45.983245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 615/1244] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:45.983887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac193070-9a0b-4a3b-bd34-d2bec4dda4ca None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:46.097864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac193070-9a0b-4a3b-bd34-d2bec4dda4ca None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:46.138070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b532741-d39c-4920-8a0b-e1b583c58d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:46.138762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b532741-d39c-4920-8a0b-e1b583c58d4e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:46.139045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b532741-d39c-4920-8a0b-e1b583c58d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:46.139359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b532741-d39c-4920-8a0b-e1b583c58d4e None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:46.140163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b532741-d39c-4920-8a0b-e1b583c58d4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:46.140528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b532741-d39c-4920-8a0b-e1b583c58d4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:46.142070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b532741-d39c-4920-8a0b-e1b583c58d4e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:46.155626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 630/1245] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:46.163003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f639a-b28d-4811-a2d5-3b512d33aba6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:46.276289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f639a-b28d-4811-a2d5-3b512d33aba6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:46.315706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92218941-4bfe-49a7-9dc0-133cb9352023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:46.316316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218941-4bfe-49a7-9dc0-133cb9352023 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:46.316670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218941-4bfe-49a7-9dc0-133cb9352023 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:46.316950 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218941-4bfe-49a7-9dc0-133cb9352023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:46.317681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92218941-4bfe-49a7-9dc0-133cb9352023 None admin] RBAC: Adding query filter params (role.id=7953b234543143eab052272480b952ec, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=1eb93baf45174c10a6fcbe321ac65764) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:46.317990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92218941-4bfe-49a7-9dc0-133cb9352023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:46.319426 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92218941-4bfe-49a7-9dc0-133cb9352023 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:46.325222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 616/1246] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:58:46 2022] GET /identity/v3/role_assignments?user.id=1eb93baf45174c10a6fcbe321ac65764&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=7953b234543143eab052272480b952ec => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:48.476295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb3933-aa2f-4a7b-ae65-307353b3afa7 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:48.476830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb3933-aa2f-4a7b-ae65-307353b3afa7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:48.476830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb3933-aa2f-4a7b-ae65-307353b3afa7 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:48.478273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 631/1247] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:58:48.484418 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc390d88-f7ed-456a-b8c0-a2e6827c161c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:48.484901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc390d88-f7ed-456a-b8c0-a2e6827c161c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:48.485001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc390d88-f7ed-456a-b8c0-a2e6827c161c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:48.492026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:48.504807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-bc390d88-f7ed-456a-b8c0-a2e6827c161c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:58:48.506068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bc390d88-f7ed-456a-b8c0-a2e6827c161c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:58:48.583740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 617/1248] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:58:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:58:48.889700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb3933-aa2f-4a7b-ae65-307353b3afa7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:48.911148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:49.014635 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb3933-aa2f-4a7b-ae65-307353b3afa7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:49.052781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2700fd-32ea-4715-86a4-49f8ea99369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:49.053418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2700fd-32ea-4715-86a4-49f8ea99369b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:49.053779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2700fd-32ea-4715-86a4-49f8ea99369b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:49.054062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2700fd-32ea-4715-86a4-49f8ea99369b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:49.064933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2700fd-32ea-4715-86a4-49f8ea99369b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5c2700fd-32ea-4715-86a4-49f8ea99369b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:58:49.070215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:49.071335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:49.072585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 632/1249] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:49.077480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc390d88-f7ed-456a-b8c0-a2e6827c161c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:49.197082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc390d88-f7ed-456a-b8c0-a2e6827c161c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:49.230236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:49.238353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aed3d1-d779-4fa6-8778-775a50520a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:49.239054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed3d1-d779-4fa6-8778-775a50520a57 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:49.239375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed3d1-d779-4fa6-8778-775a50520a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:49.239696 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed3d1-d779-4fa6-8778-775a50520a57 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:49.240446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aed3d1-d779-4fa6-8778-775a50520a57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:49.240753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aed3d1-d779-4fa6-8778-775a50520a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:49.242184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aed3d1-d779-4fa6-8778-775a50520a57 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:49.251383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 618/1250] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:49.258096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2700fd-32ea-4715-86a4-49f8ea99369b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:49.346422 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:49.369275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2700fd-32ea-4715-86a4-49f8ea99369b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:49.406204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd88f7d-2fef-4b89-ab6b-69fb28349f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:49.406953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88f7d-2fef-4b89-ab6b-69fb28349f5d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:49.407239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88f7d-2fef-4b89-ab6b-69fb28349f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:49.407518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88f7d-2fef-4b89-ab6b-69fb28349f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:49.418437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd88f7d-2fef-4b89-ab6b-69fb28349f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:49.420376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd88f7d-2fef-4b89-ab6b-69fb28349f5d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4fd88f7d-2fef-4b89-ab6b-69fb28349f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:49.437601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:49.438795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:49.439723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:49.439723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:49.439723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:49.439723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 633/1251] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:49.445774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aed3d1-d779-4fa6-8778-775a50520a57 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:49.559756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aed3d1-d779-4fa6-8778-775a50520a57 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:49.595339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668656e-8411-4b52-be94-301f4c2f6630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:49.595953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668656e-8411-4b52-be94-301f4c2f6630 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:49.596239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668656e-8411-4b52-be94-301f4c2f6630 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:49.596548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668656e-8411-4b52-be94-301f4c2f6630 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:49.597191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668656e-8411-4b52-be94-301f4c2f6630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:49.597499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668656e-8411-4b52-be94-301f4c2f6630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:49.599594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668656e-8411-4b52-be94-301f4c2f6630 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:49.614131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 619/1252] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:49.620421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd88f7d-2fef-4b89-ab6b-69fb28349f5d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:49.729331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd88f7d-2fef-4b89-ab6b-69fb28349f5d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:49.756849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:49.765476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d441-2307-45b4-b8cc-023937c4b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:49.766117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d441-2307-45b4-b8cc-023937c4b117 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:49.766404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d441-2307-45b4-b8cc-023937c4b117 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:49.766747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d441-2307-45b4-b8cc-023937c4b117 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:49.776148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224d441-2307-45b4-b8cc-023937c4b117 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:49.777939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224d441-2307-45b4-b8cc-023937c4b117 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6224d441-2307-45b4-b8cc-023937c4b117 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:58:49.791136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:49.792228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:49.793391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 634/1253] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:58:49.798342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668656e-8411-4b52-be94-301f4c2f6630 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:49.857059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:49.904181 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668656e-8411-4b52-be94-301f4c2f6630 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:49.940069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87652-e615-4124-8647-ebdc34daa0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:49.940748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87652-e615-4124-8647-ebdc34daa0cf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:49.941042 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87652-e615-4124-8647-ebdc34daa0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:49.941299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87652-e615-4124-8647-ebdc34daa0cf None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:49.942702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab87652-e615-4124-8647-ebdc34daa0cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:49.942979 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab87652-e615-4124-8647-ebdc34daa0cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:49.944421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab87652-e615-4124-8647-ebdc34daa0cf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:49.962709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 620/1254] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Aug 31 00:58:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:49.968929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d441-2307-45b4-b8cc-023937c4b117 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:50.079357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d441-2307-45b4-b8cc-023937c4b117 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:50.114696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd55540-446b-46f6-ae8c-438d0cf0787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:50.115306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd55540-446b-46f6-ae8c-438d0cf0787c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:50.115583 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd55540-446b-46f6-ae8c-438d0cf0787c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:50.115853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd55540-446b-46f6-ae8c-438d0cf0787c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:50.182985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:50.199605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd55540-446b-46f6-ae8c-438d0cf0787c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:50.201086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd55540-446b-46f6-ae8c-438d0cf0787c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:50.312636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 635/1255] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:58:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:58:50.320185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87652-e615-4124-8647-ebdc34daa0cf None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:50.434189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87652-e615-4124-8647-ebdc34daa0cf None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:50.448281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:50.473766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673e2df-0b17-44b3-a231-a60dea5f5855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:50.474655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e2df-0b17-44b3-a231-a60dea5f5855 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:50.475084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e2df-0b17-44b3-a231-a60dea5f5855 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:50.475549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e2df-0b17-44b3-a231-a60dea5f5855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:50.487481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673e2df-0b17-44b3-a231-a60dea5f5855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:50.489347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673e2df-0b17-44b3-a231-a60dea5f5855 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9673e2df-0b17-44b3-a231-a60dea5f5855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:50.504999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:50.506190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:50.507109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:50.507109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:50.507109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:50.507109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 621/1256] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:50.512264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd55540-446b-46f6-ae8c-438d0cf0787c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:50.606779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:50.621478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd55540-446b-46f6-ae8c-438d0cf0787c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:50.663256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235956a-e176-4d04-bbbe-e0d22b8420d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:50.663946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235956a-e176-4d04-bbbe-e0d22b8420d4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:50.664343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235956a-e176-4d04-bbbe-e0d22b8420d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:50.664725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235956a-e176-4d04-bbbe-e0d22b8420d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:50.665516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235956a-e176-4d04-bbbe-e0d22b8420d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:50.665923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235956a-e176-4d04-bbbe-e0d22b8420d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:50.667961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235956a-e176-4d04-bbbe-e0d22b8420d4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:50.682181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 636/1257] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:50.688023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673e2df-0b17-44b3-a231-a60dea5f5855 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:50.799539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673e2df-0b17-44b3-a231-a60dea5f5855 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:50.837380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4614766-0f1e-4659-9afd-cdaf30fadf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:50.838018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4614766-0f1e-4659-9afd-cdaf30fadf30 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:50.838338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4614766-0f1e-4659-9afd-cdaf30fadf30 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:50.838579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4614766-0f1e-4659-9afd-cdaf30fadf30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:50.845713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4614766-0f1e-4659-9afd-cdaf30fadf30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:50.847141 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4614766-0f1e-4659-9afd-cdaf30fadf30 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c4614766-0f1e-4659-9afd-cdaf30fadf30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:58:50.860311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:50.861484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:50.862702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:58:50.862702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:58:50.862702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:58:50.862702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:58:50.862702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:58:50.862702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:58:50.862702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:50.862702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:50.862702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 622/1258] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:50.869927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235956a-e176-4d04-bbbe-e0d22b8420d4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:50.982172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235956a-e176-4d04-bbbe-e0d22b8420d4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:51.019525 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d70eb-ceeb-4e96-9f0d-e56ceb97ad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:51.020927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d70eb-ceeb-4e96-9f0d-e56ceb97ad67 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:51.021219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d70eb-ceeb-4e96-9f0d-e56ceb97ad67 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:51.021502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d70eb-ceeb-4e96-9f0d-e56ceb97ad67 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:51.022217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d70eb-ceeb-4e96-9f0d-e56ceb97ad67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:51.022530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d70eb-ceeb-4e96-9f0d-e56ceb97ad67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:51.023975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d70eb-ceeb-4e96-9f0d-e56ceb97ad67 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:51.037919 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 637/1259] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:51.044142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4614766-0f1e-4659-9afd-cdaf30fadf30 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:51.073203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:51.157258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4614766-0f1e-4659-9afd-cdaf30fadf30 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:51.192850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285b23-5665-4af7-a8e9-79e82c7e57ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:51.193474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285b23-5665-4af7-a8e9-79e82c7e57ce None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:51.193760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285b23-5665-4af7-a8e9-79e82c7e57ce None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:51.194045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285b23-5665-4af7-a8e9-79e82c7e57ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:51.194885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285b23-5665-4af7-a8e9-79e82c7e57ce None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=1eb93baf45174c10a6fcbe321ac65764) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:51.195207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285b23-5665-4af7-a8e9-79e82c7e57ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:51.196712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285b23-5665-4af7-a8e9-79e82c7e57ce None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:51.203066 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 623/1260] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:58:51 2022] GET /identity/v3/role_assignments?user.id=1eb93baf45174c10a6fcbe321ac65764&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:53.120497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3eb74-53d4-48be-aa97-6126688e6c52 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:53.121059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3eb74-53d4-48be-aa97-6126688e6c52 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:53.121059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3eb74-53d4-48be-aa97-6126688e6c52 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:53.122368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 638/1261] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:58:53.127405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347620-2757-4b48-b3ff-91ead929c81f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:53.127837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347620-2757-4b48-b3ff-91ead929c81f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:53.127972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347620-2757-4b48-b3ff-91ead929c81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:53.146986 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-36347620-2757-4b48-b3ff-91ead929c81f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:58:53.148197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-36347620-2757-4b48-b3ff-91ead929c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:58:53.213511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 624/1262] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:58:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:58:53.488735 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3eb74-53d4-48be-aa97-6126688e6c52 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:53.499473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:53.586999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3eb74-53d4-48be-aa97-6126688e6c52 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:53.624144 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e13788-70c6-404a-83c3-c6aa10fd0c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:53.624821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e13788-70c6-404a-83c3-c6aa10fd0c2f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:53.625117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e13788-70c6-404a-83c3-c6aa10fd0c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:53.625389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e13788-70c6-404a-83c3-c6aa10fd0c2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:53.638564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e13788-70c6-404a-83c3-c6aa10fd0c2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b9e13788-70c6-404a-83c3-c6aa10fd0c2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:58:53.643395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:53.645250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:53.646193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 639/1263] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:58:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:53.651428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36347620-2757-4b48-b3ff-91ead929c81f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:53.671259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:53.757470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36347620-2757-4b48-b3ff-91ead929c81f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:53.790101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ed2f-d76e-4321-b24f-7226242274b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:53.790699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ed2f-d76e-4321-b24f-7226242274b6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:53.790980 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ed2f-d76e-4321-b24f-7226242274b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:53.791254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ed2f-d76e-4321-b24f-7226242274b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:53.791914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ed2f-d76e-4321-b24f-7226242274b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:53.792216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ed2f-d76e-4321-b24f-7226242274b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:53.793601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ed2f-d76e-4321-b24f-7226242274b6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:53.801335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 625/1264] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:58:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:53.807227 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e13788-70c6-404a-83c3-c6aa10fd0c2f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:53.872087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:53.905393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e13788-70c6-404a-83c3-c6aa10fd0c2f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:53.939743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60952de8-e387-411f-b92d-f0e250b27941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:53.944494 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60952de8-e387-411f-b92d-f0e250b27941 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:53.944785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60952de8-e387-411f-b92d-f0e250b27941 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:53.945068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60952de8-e387-411f-b92d-f0e250b27941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:53.955887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60952de8-e387-411f-b92d-f0e250b27941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:53.958017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60952de8-e387-411f-b92d-f0e250b27941 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-60952de8-e387-411f-b92d-f0e250b27941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:53.972290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:53.973419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:53.974389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:53.974389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:53.974389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:53.974389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 640/1265] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:53.979643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ed2f-d76e-4321-b24f-7226242274b6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:54.059354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:54.079346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ed2f-d76e-4321-b24f-7226242274b6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:54.112074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129fa30-e5ef-4491-a27c-c79665c07653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:54.112699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129fa30-e5ef-4491-a27c-c79665c07653 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:54.112981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129fa30-e5ef-4491-a27c-c79665c07653 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:54.113752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129fa30-e5ef-4491-a27c-c79665c07653 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:54.114462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129fa30-e5ef-4491-a27c-c79665c07653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:54.114767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129fa30-e5ef-4491-a27c-c79665c07653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:54.116111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129fa30-e5ef-4491-a27c-c79665c07653 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:54.127470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 626/1266] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:54.133939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60952de8-e387-411f-b92d-f0e250b27941 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:54.230873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60952de8-e387-411f-b92d-f0e250b27941 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:54.249883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:54.264412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f74e52-05fc-4152-8c86-eab550d5b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:54.265028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f74e52-05fc-4152-8c86-eab550d5b201 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:54.265312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f74e52-05fc-4152-8c86-eab550d5b201 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:54.265586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f74e52-05fc-4152-8c86-eab550d5b201 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:54.272890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f74e52-05fc-4152-8c86-eab550d5b201 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:54.274313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f74e52-05fc-4152-8c86-eab550d5b201 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f8f74e52-05fc-4152-8c86-eab550d5b201 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:58:54.285051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:54.290297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:54.291470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 641/1267] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:54.292227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129fa30-e5ef-4491-a27c-c79665c07653 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:54.391860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129fa30-e5ef-4491-a27c-c79665c07653 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:54.426407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd98f1-47a8-415a-8069-d294a4cea5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:54.427015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd98f1-47a8-415a-8069-d294a4cea5bf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:54.427298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd98f1-47a8-415a-8069-d294a4cea5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:54.427569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd98f1-47a8-415a-8069-d294a4cea5bf None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:54.428296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd98f1-47a8-415a-8069-d294a4cea5bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:54.428638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd98f1-47a8-415a-8069-d294a4cea5bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:54.430060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd98f1-47a8-415a-8069-d294a4cea5bf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:54.438591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:54.446965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 627/1268] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Aug 31 00:58:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:58:54.452799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f74e52-05fc-4152-8c86-eab550d5b201 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:54.549897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f74e52-05fc-4152-8c86-eab550d5b201 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:54.582035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf094791-5750-4260-9fa7-22bf3bdb00b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:54.582530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf094791-5750-4260-9fa7-22bf3bdb00b5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:54.582811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf094791-5750-4260-9fa7-22bf3bdb00b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:54.583087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf094791-5750-4260-9fa7-22bf3bdb00b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:54.593405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf094791-5750-4260-9fa7-22bf3bdb00b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:54.594832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf094791-5750-4260-9fa7-22bf3bdb00b5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cf094791-5750-4260-9fa7-22bf3bdb00b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:54.609145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:54.610482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:54.611597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:54.611597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:54.611597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:54.611597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 642/1269] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:54.617551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd98f1-47a8-415a-8069-d294a4cea5bf None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:54.717470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd98f1-47a8-415a-8069-d294a4cea5bf None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:54.751089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72519f2-1422-4b4d-9daf-2d1d1474d47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:54.751675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72519f2-1422-4b4d-9daf-2d1d1474d47d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:54.751956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72519f2-1422-4b4d-9daf-2d1d1474d47d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:54.752229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72519f2-1422-4b4d-9daf-2d1d1474d47d None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:54.752936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72519f2-1422-4b4d-9daf-2d1d1474d47d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:54.753246 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72519f2-1422-4b4d-9daf-2d1d1474d47d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:54.754763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72519f2-1422-4b4d-9daf-2d1d1474d47d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:54.765590 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 628/1270] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:54.771627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf094791-5750-4260-9fa7-22bf3bdb00b5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:54.803133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:54.870442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf094791-5750-4260-9fa7-22bf3bdb00b5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:54.903878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5f2e-448b-412c-8234-d955a2ec7f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:54.904521 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5f2e-448b-412c-8234-d955a2ec7f01 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:54.904802 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5f2e-448b-412c-8234-d955a2ec7f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:54.905075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5f2e-448b-412c-8234-d955a2ec7f01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:54.912233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c5f2e-448b-412c-8234-d955a2ec7f01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:54.913690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c5f2e-448b-412c-8234-d955a2ec7f01 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-656c5f2e-448b-412c-8234-d955a2ec7f01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:58:54.924594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:54.925615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:54.927137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:58:54.927137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:58:54.927137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:58:54.927137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:58:54.927137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:58:54.927137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:58:54.927137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:54.927137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:54.927137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 643/1271] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:58:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:54.932153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72519f2-1422-4b4d-9daf-2d1d1474d47d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:54.994284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:55.035807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72519f2-1422-4b4d-9daf-2d1d1474d47d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:55.068861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473cca2-123c-4dda-823f-e72459cffc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:55.069463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473cca2-123c-4dda-823f-e72459cffc2b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:55.069748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473cca2-123c-4dda-823f-e72459cffc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:55.070027 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473cca2-123c-4dda-823f-e72459cffc2b None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:55.070718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473cca2-123c-4dda-823f-e72459cffc2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:55.071030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473cca2-123c-4dda-823f-e72459cffc2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:55.072481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473cca2-123c-4dda-823f-e72459cffc2b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:55.083952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 629/1272] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:55.090199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5f2e-448b-412c-8234-d955a2ec7f01 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:55.180947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:55.189736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5f2e-448b-412c-8234-d955a2ec7f01 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:55.222249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261be221-5ee7-4be1-82a8-41ffd98486a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:55.223409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261be221-5ee7-4be1-82a8-41ffd98486a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:55.223683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261be221-5ee7-4be1-82a8-41ffd98486a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:55.224089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261be221-5ee7-4be1-82a8-41ffd98486a6 None admin] PATH_INFO: `/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/1eb93baf45174c10a6fcbe321ac65764/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:55.226001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261be221-5ee7-4be1-82a8-41ffd98486a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc3624d0e59c4f84a9b132c17ebdd932, user_id=1eb93baf45174c10a6fcbe321ac65764, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:55.227426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261be221-5ee7-4be1-82a8-41ffd98486a6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:55.239785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 644/1273] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Aug 31 00:58:55 2022] PUT /identity/v3/projects/cc3624d0e59c4f84a9b132c17ebdd932/users/1eb93baf45174c10a6fcbe321ac65764/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:58:57.123912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916a80-c643-4d15-8ba7-6e8eee8b2392 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:57.124512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916a80-c643-4d15-8ba7-6e8eee8b2392 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:57.124512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916a80-c643-4d15-8ba7-6e8eee8b2392 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:57.125848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 630/1274] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:58:57.131375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3be7a9-1fa4-4ecf-9298-ce45c488fc68 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:57.131776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3be7a9-1fa4-4ecf-9298-ce45c488fc68 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:57.131932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3be7a9-1fa4-4ecf-9298-ce45c488fc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:57.151193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8c3be7a9-1fa4-4ecf-9298-ce45c488fc68 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:58:57.152475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8c3be7a9-1fa4-4ecf-9298-ce45c488fc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:58:57.218057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 645/1275] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:58:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:58:57.510746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f916a80-c643-4d15-8ba7-6e8eee8b2392 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:57.611010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f916a80-c643-4d15-8ba7-6e8eee8b2392 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:57.630826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:57.651784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1b01a-01f3-49a4-9155-12fa8ed24617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:57.652551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1b01a-01f3-49a4-9155-12fa8ed24617 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:57.652838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1b01a-01f3-49a4-9155-12fa8ed24617 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:57.653203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1b01a-01f3-49a4-9155-12fa8ed24617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:57.665621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1b01a-01f3-49a4-9155-12fa8ed24617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e5d1b01a-01f3-49a4-9155-12fa8ed24617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:58:57.671312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:57.672505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:57.673491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 631/1276] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Aug 31 00:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:57.679978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3be7a9-1fa4-4ecf-9298-ce45c488fc68 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:57.764129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:57.782208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3be7a9-1fa4-4ecf-9298-ce45c488fc68 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:57.815623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ec3d-a535-4f18-9f2c-e05384d8e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:57.816254 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ec3d-a535-4f18-9f2c-e05384d8e120 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:57.816583 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ec3d-a535-4f18-9f2c-e05384d8e120 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:57.816862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ec3d-a535-4f18-9f2c-e05384d8e120 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:57.817523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14ec3d-a535-4f18-9f2c-e05384d8e120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:57.817829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14ec3d-a535-4f18-9f2c-e05384d8e120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:57.819183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14ec3d-a535-4f18-9f2c-e05384d8e120 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:57.826887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 646/1277] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Aug 31 00:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:57.833373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1b01a-01f3-49a4-9155-12fa8ed24617 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:57.933845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1b01a-01f3-49a4-9155-12fa8ed24617 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:57.968303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa37544-1919-4506-8256-645892a56504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:57.968948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa37544-1919-4506-8256-645892a56504 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:57.969228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa37544-1919-4506-8256-645892a56504 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:57.969502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa37544-1919-4506-8256-645892a56504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:57.979037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa37544-1919-4506-8256-645892a56504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:57.980490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa37544-1919-4506-8256-645892a56504 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9fa37544-1919-4506-8256-645892a56504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:57.995109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:57.996285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:57.997356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:57.997356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:57.997356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:57.997356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 632/1278] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:58.002143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ec3d-a535-4f18-9f2c-e05384d8e120 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:58.104794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ec3d-a535-4f18-9f2c-e05384d8e120 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:58.137942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200cfd3-520a-404d-90c1-d7aeda4815b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:58.138533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200cfd3-520a-404d-90c1-d7aeda4815b1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:58.138806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200cfd3-520a-404d-90c1-d7aeda4815b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:58.139075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200cfd3-520a-404d-90c1-d7aeda4815b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:58.139704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200cfd3-520a-404d-90c1-d7aeda4815b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:58.140005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200cfd3-520a-404d-90c1-d7aeda4815b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:58.141391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200cfd3-520a-404d-90c1-d7aeda4815b1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:58.153264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 647/1279] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:58.159045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa37544-1919-4506-8256-645892a56504 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:58.190319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:58.258716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa37544-1919-4506-8256-645892a56504 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:58.291269 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a735f-70cd-4f43-a86e-efc79ea6d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:58.291880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a735f-70cd-4f43-a86e-efc79ea6d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:58.292161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a735f-70cd-4f43-a86e-efc79ea6d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:58.292468 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a735f-70cd-4f43-a86e-efc79ea6d5a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:58.299530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a735f-70cd-4f43-a86e-efc79ea6d5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:58.301651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a735f-70cd-4f43-a86e-efc79ea6d5a1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7a4a735f-70cd-4f43-a86e-efc79ea6d5a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:58:58.312509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:58.313648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:58:58.314853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 633/1280] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:58.319494 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200cfd3-520a-404d-90c1-d7aeda4815b1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:58.323273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:58.418064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200cfd3-520a-404d-90c1-d7aeda4815b1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:58.451548 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6ff62-0111-460c-a8bb-bf01209ccee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:58.452146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ff62-0111-460c-a8bb-bf01209ccee9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:58.452458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ff62-0111-460c-a8bb-bf01209ccee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:58.452737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ff62-0111-460c-a8bb-bf01209ccee9 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:58.453462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6ff62-0111-460c-a8bb-bf01209ccee9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:58.453774 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6ff62-0111-460c-a8bb-bf01209ccee9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:58.455196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6ff62-0111-460c-a8bb-bf01209ccee9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:58.472171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 648/1281] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Aug 31 00:58:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:58.478521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a735f-70cd-4f43-a86e-efc79ea6d5a1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:58.566581 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:58.576294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a735f-70cd-4f43-a86e-efc79ea6d5a1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:58.610194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2765b-1120-43aa-aaf1-c019c90b2bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:58.610858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2765b-1120-43aa-aaf1-c019c90b2bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:58.611147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2765b-1120-43aa-aaf1-c019c90b2bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:58.611423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2765b-1120-43aa-aaf1-c019c90b2bf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:58.679344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2765b-1120-43aa-aaf1-c019c90b2bf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:58.680735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2765b-1120-43aa-aaf1-c019c90b2bf9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:58.765019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:58.775745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 634/1282] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Aug 31 00:58:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:58:58.781793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6ff62-0111-460c-a8bb-bf01209ccee9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:58.841710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:58.879516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6ff62-0111-460c-a8bb-bf01209ccee9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:58.912736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072f012-97b7-4cf9-83c8-d4eaa340ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:58.913352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072f012-97b7-4cf9-83c8-d4eaa340ff08 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:58.913630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072f012-97b7-4cf9-83c8-d4eaa340ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:58.913904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072f012-97b7-4cf9-83c8-d4eaa340ff08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:58.923379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072f012-97b7-4cf9-83c8-d4eaa340ff08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:58.924837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072f012-97b7-4cf9-83c8-d4eaa340ff08 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9072f012-97b7-4cf9-83c8-d4eaa340ff08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:58:58.939629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:58.940768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:58:58.942690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:58:58.942690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:58:58.942690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:58.942690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 649/1283] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 00:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:58:58.946962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2765b-1120-43aa-aaf1-c019c90b2bf9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:59.043592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2765b-1120-43aa-aaf1-c019c90b2bf9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:59.076778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5c21c-1571-4079-9cf1-3dafcbb2ff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:59.077372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5c21c-1571-4079-9cf1-3dafcbb2ff4f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:59.077653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5c21c-1571-4079-9cf1-3dafcbb2ff4f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:59.077928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5c21c-1571-4079-9cf1-3dafcbb2ff4f None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:59.078562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5c21c-1571-4079-9cf1-3dafcbb2ff4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:59.078867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5c21c-1571-4079-9cf1-3dafcbb2ff4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:59.080215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5c21c-1571-4079-9cf1-3dafcbb2ff4f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:59.091571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 635/1284] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Aug 31 00:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:59.097103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072f012-97b7-4cf9-83c8-d4eaa340ff08 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:59.195569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072f012-97b7-4cf9-83c8-d4eaa340ff08 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:59.209116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:59.229574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76876fa-f9c9-4b32-a776-bd684bb9925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:59.230198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76876fa-f9c9-4b32-a776-bd684bb9925c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:59.230481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76876fa-f9c9-4b32-a776-bd684bb9925c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:59.230756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76876fa-f9c9-4b32-a776-bd684bb9925c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:59.237213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76876fa-f9c9-4b32-a776-bd684bb9925c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:59.239265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76876fa-f9c9-4b32-a776-bd684bb9925c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f76876fa-f9c9-4b32-a776-bd684bb9925c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:58:59.250238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:58:59.251253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:58:59.252178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:58:59.252178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:58:59.252178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:58:59.252178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:58:59.252178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:58:59.252178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:58:59.252178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:58:59.252178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 00:58:59.252178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 650/1285] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Aug 31 00:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:58:59.257344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5c21c-1571-4079-9cf1-3dafcbb2ff4f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:59.306876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:59.358478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5c21c-1571-4079-9cf1-3dafcbb2ff4f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:59.395363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7dc69-be3a-4df5-ad48-fad1f9e8d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:59.395964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7dc69-be3a-4df5-ad48-fad1f9e8d6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:59.396243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7dc69-be3a-4df5-ad48-fad1f9e8d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:59.396542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7dc69-be3a-4df5-ad48-fad1f9e8d6e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:59.397234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7dc69-be3a-4df5-ad48-fad1f9e8d6e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:59.397539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7dc69-be3a-4df5-ad48-fad1f9e8d6e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:59.398961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7dc69-be3a-4df5-ad48-fad1f9e8d6e5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:59.411096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 636/1286] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Aug 31 00:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:58:59.417194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76876fa-f9c9-4b32-a776-bd684bb9925c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:58:59.514923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76876fa-f9c9-4b32-a776-bd684bb9925c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:58:59.547596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc7e46-462d-4852-8bc1-6966b7bc00a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:58:59.548183 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc7e46-462d-4852-8bc1-6966b7bc00a4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:58:59.548492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc7e46-462d-4852-8bc1-6966b7bc00a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:58:59.548768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc7e46-462d-4852-8bc1-6966b7bc00a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:58:59.549481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc7e46-462d-4852-8bc1-6966b7bc00a4 None admin] RBAC: Adding query filter params (role.id=5ebfd449cc6d4760b8d292f3877f4d64, scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932, user.id=1eb93baf45174c10a6fcbe321ac65764) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:58:59.549790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc7e46-462d-4852-8bc1-6966b7bc00a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:58:59.551325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc7e46-462d-4852-8bc1-6966b7bc00a4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:58:59.556875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 651/1287] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Aug 31 00:58:59 2022] GET /identity/v3/role_assignments?user.id=1eb93baf45174c10a6fcbe321ac65764&scope.project.id=cc3624d0e59c4f84a9b132c17ebdd932&role.id=5ebfd449cc6d4760b8d292f3877f4d64 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:59:01.469114 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f20f9-8721-4ceb-a1b7-925b9dc6aebb None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:01.469616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f20f9-8721-4ceb-a1b7-925b9dc6aebb None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:01.469616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f20f9-8721-4ceb-a1b7-925b9dc6aebb None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:01.470909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 637/1288] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:59:01.475892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59820aed-7f03-4149-9754-b1834cce0fc5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:01.476283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59820aed-7f03-4149-9754-b1834cce0fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:01.476474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59820aed-7f03-4149-9754-b1834cce0fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:01.494176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-59820aed-7f03-4149-9754-b1834cce0fc5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:59:01.495357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-59820aed-7f03-4149-9754-b1834cce0fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:59:01.524783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:01.561452 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 652/1289] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:59:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:59:01.830535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f20f9-8721-4ceb-a1b7-925b9dc6aebb None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:01.930650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f20f9-8721-4ceb-a1b7-925b9dc6aebb None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:01.940881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:01.964456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671171f9-1895-47bd-903c-2e52918d0eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:01.965081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671171f9-1895-47bd-903c-2e52918d0eaf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:01.965365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671171f9-1895-47bd-903c-2e52918d0eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:01.965641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671171f9-1895-47bd-903c-2e52918d0eaf None admin] PATH_INFO: `/v3/services/placement` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:01.966221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671171f9-1895-47bd-903c-2e52918d0eaf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:01.967577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671171f9-1895-47bd-903c-2e52918d0eaf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-671171f9-1895-47bd-903c-2e52918d0eaf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:59:01.977479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:59:01.978750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:59:01.979803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 638/1290] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Aug 31 00:59:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:59:01.984688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59820aed-7f03-4149-9754-b1834cce0fc5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:02.083170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59820aed-7f03-4149-9754-b1834cce0fc5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:02.116861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e225b7-d04c-42a5-a4f5-0d5a9db20596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:02.117453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e225b7-d04c-42a5-a4f5-0d5a9db20596 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:02.117727 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e225b7-d04c-42a5-a4f5-0d5a9db20596 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:02.117995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e225b7-d04c-42a5-a4f5-0d5a9db20596 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:02.118612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e225b7-d04c-42a5-a4f5-0d5a9db20596 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:59:02.118911 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e225b7-d04c-42a5-a4f5-0d5a9db20596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:02.120254 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e225b7-d04c-42a5-a4f5-0d5a9db20596 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:02.125083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 653/1291] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Aug 31 00:59:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:59:02.130782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671171f9-1895-47bd-903c-2e52918d0eaf None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:02.228770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671171f9-1895-47bd-903c-2e52918d0eaf None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:02.261339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4deaa23-74c3-4ad2-a862-a43f1c6b292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:02.261945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4deaa23-74c3-4ad2-a862-a43f1c6b292f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:02.262228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4deaa23-74c3-4ad2-a862-a43f1c6b292f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:02.262505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4deaa23-74c3-4ad2-a862-a43f1c6b292f None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:02.263135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4deaa23-74c3-4ad2-a862-a43f1c6b292f None admin] RBAC: Adding query filter params (type=placement) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:59:02.263440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4deaa23-74c3-4ad2-a862-a43f1c6b292f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:02.264832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4deaa23-74c3-4ad2-a862-a43f1c6b292f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:02.269128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 639/1292] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Aug 31 00:59:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:59:04.153749 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7875159-b957-4960-b28a-9a636ac9bc02 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:04.154182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7875159-b957-4960-b28a-9a636ac9bc02 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:04.154304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7875159-b957-4960-b28a-9a636ac9bc02 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:04.155623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 654/1293] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:59:04.161446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa7af1-1219-44bb-a1d5-d2c5688c6541 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:04.161836 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa7af1-1219-44bb-a1d5-d2c5688c6541 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:04.161996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa7af1-1219-44bb-a1d5-d2c5688c6541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:04.179765 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-91aa7af1-1219-44bb-a1d5-d2c5688c6541 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:59:04.180982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-91aa7af1-1219-44bb-a1d5-d2c5688c6541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:59:04.210846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:04.247254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 640/1294] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:59:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:59:04.520617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7875159-b957-4960-b28a-9a636ac9bc02 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:04.551047 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:04.621851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7875159-b957-4960-b28a-9a636ac9bc02 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:04.666887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68259a8a-6192-4e00-8e29-f8d5e9806197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:04.667578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68259a8a-6192-4e00-8e29-f8d5e9806197 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:04.667981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68259a8a-6192-4e00-8e29-f8d5e9806197 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:04.668298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68259a8a-6192-4e00-8e29-f8d5e9806197 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:04.669248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68259a8a-6192-4e00-8e29-f8d5e9806197 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:04.671099 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68259a8a-6192-4e00-8e29-f8d5e9806197 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:04.689738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 655/1295] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Aug 31 00:59:04 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:59:06.591573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f07d2-eced-4ad0-b231-291a1dd77cf1 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:06.592091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f07d2-eced-4ad0-b231-291a1dd77cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:06.592091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f07d2-eced-4ad0-b231-291a1dd77cf1 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:06.593411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 641/1296] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:59:06.598441 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db4cc-0fc0-484e-972e-ca18f712e43a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:06.598822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db4cc-0fc0-484e-972e-ca18f712e43a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:06.598997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db4cc-0fc0-484e-972e-ca18f712e43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:06.618004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5b7db4cc-0fc0-484e-972e-ca18f712e43a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:59:06.619261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5b7db4cc-0fc0-484e-972e-ca18f712e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:59:06.690206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 656/1297] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:59:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:59:06.960511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f07d2-eced-4ad0-b231-291a1dd77cf1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:07.065374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f07d2-eced-4ad0-b231-291a1dd77cf1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:07.099056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ce1c6-73dd-4a5d-8484-0ccebc2ba274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:07.099675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ce1c6-73dd-4a5d-8484-0ccebc2ba274 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:07.099960 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ce1c6-73dd-4a5d-8484-0ccebc2ba274 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:07.100236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ce1c6-73dd-4a5d-8484-0ccebc2ba274 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:07.100852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ce1c6-73dd-4a5d-8484-0ccebc2ba274 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:07.102241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ce1c6-73dd-4a5d-8484-0ccebc2ba274 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-617ce1c6-73dd-4a5d-8484-0ccebc2ba274 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:59:07.110721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:59:07.111834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:59:07.112713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 642/1298] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Aug 31 00:59:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:59:07.118063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7db4cc-0fc0-484e-972e-ca18f712e43a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:07.135864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:07.215756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7db4cc-0fc0-484e-972e-ca18f712e43a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:07.247986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3781283-4b03-4738-b102-355ab3dad6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:07.248629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3781283-4b03-4738-b102-355ab3dad6be None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:07.248913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3781283-4b03-4738-b102-355ab3dad6be None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:07.249190 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3781283-4b03-4738-b102-355ab3dad6be None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:07.249815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3781283-4b03-4738-b102-355ab3dad6be None admin] RBAC: Adding query filter params (name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:59:07.250120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3781283-4b03-4738-b102-355ab3dad6be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:07.251473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3781283-4b03-4738-b102-355ab3dad6be None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:07.257011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 657/1299] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Aug 31 00:59:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:59:07.263122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ce1c6-73dd-4a5d-8484-0ccebc2ba274 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:07.294705 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:07.363326 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ce1c6-73dd-4a5d-8484-0ccebc2ba274 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:07.401818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effcaf1-0945-4b0d-b4bf-67845977c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:07.402437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effcaf1-0945-4b0d-b4bf-67845977c927 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:07.402720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effcaf1-0945-4b0d-b4bf-67845977c927 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:07.402995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effcaf1-0945-4b0d-b4bf-67845977c927 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:07.403707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effcaf1-0945-4b0d-b4bf-67845977c927 None admin] RBAC: Adding query filter params (interface=public, service_id=0ddddea7ccad494b8cce85b408074b1c, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:59:07.404019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effcaf1-0945-4b0d-b4bf-67845977c927 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:07.405417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effcaf1-0945-4b0d-b4bf-67845977c927 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:07.410705 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 643/1300] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Aug 31 00:59:07 2022] GET /identity/v3/endpoints?service_id=0ddddea7ccad494b8cce85b408074b1c&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:59:07.416410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3781283-4b03-4738-b102-355ab3dad6be None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:07.495247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:07.513498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3781283-4b03-4738-b102-355ab3dad6be None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:07.547752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e7ccc-fe65-4b10-a64e-68f11ee3c3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:07.548373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7ccc-fe65-4b10-a64e-68f11ee3c3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:07.548661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7ccc-fe65-4b10-a64e-68f11ee3c3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:07.548937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7ccc-fe65-4b10-a64e-68f11ee3c3e7 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:07.549541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e7ccc-fe65-4b10-a64e-68f11ee3c3e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:07.551550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e7ccc-fe65-4b10-a64e-68f11ee3c3e7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:07.558213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 658/1301] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Aug 31 00:59:07 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:59:09.467830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e64607-a6eb-467e-966d-4218dbf019c9 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:09.468379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e64607-a6eb-467e-966d-4218dbf019c9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:09.468379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e64607-a6eb-467e-966d-4218dbf019c9 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:09.469661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 644/1302] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 00:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:59:09.475297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb02d-8bab-4b19-a417-9d1a7a573196 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:09.475726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb02d-8bab-4b19-a417-9d1a7a573196 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:09.475860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb02d-8bab-4b19-a417-9d1a7a573196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:09.494189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-523fb02d-8bab-4b19-a417-9d1a7a573196 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:59:09.495376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-523fb02d-8bab-4b19-a417-9d1a7a573196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:59:09.559942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 659/1303] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 00:59:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:59:09.829349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e64607-a6eb-467e-966d-4218dbf019c9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:09.922768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:09.929594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e64607-a6eb-467e-966d-4218dbf019c9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:09.962539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8d091-1b04-40be-9bb5-ac48de03f780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:09.963164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8d091-1b04-40be-9bb5-ac48de03f780 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:09.963448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8d091-1b04-40be-9bb5-ac48de03f780 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:09.963724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8d091-1b04-40be-9bb5-ac48de03f780 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:09.964584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8d091-1b04-40be-9bb5-ac48de03f780 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:09.965960 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8d091-1b04-40be-9bb5-ac48de03f780 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c9b8d091-1b04-40be-9bb5-ac48de03f780 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:59:09.975057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:59:09.976225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 00:59:09.977316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 645/1304] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Aug 31 00:59:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:59:09.982230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fb02d-8bab-4b19-a417-9d1a7a573196 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:10.055333 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:10.077377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fb02d-8bab-4b19-a417-9d1a7a573196 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:10.111459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3887b-b2e8-489b-9316-0aa7d5e2e034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:10.111991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3887b-b2e8-489b-9316-0aa7d5e2e034 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:10.112272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3887b-b2e8-489b-9316-0aa7d5e2e034 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:10.112594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3887b-b2e8-489b-9316-0aa7d5e2e034 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:10.113285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3887b-b2e8-489b-9316-0aa7d5e2e034 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:59:10.113582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3887b-b2e8-489b-9316-0aa7d5e2e034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:10.114931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3887b-b2e8-489b-9316-0aa7d5e2e034 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:10.119915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 660/1305] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Aug 31 00:59:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:59:10.125929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8d091-1b04-40be-9bb5-ac48de03f780 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:59:10.225337 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8d091-1b04-40be-9bb5-ac48de03f780 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:59:10.257954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0744ac-0c69-4ea7-a0b9-42c4f44675d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:59:10.258556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0744ac-0c69-4ea7-a0b9-42c4f44675d9 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:59:10.258840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0744ac-0c69-4ea7-a0b9-42c4f44675d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:59:10.259115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0744ac-0c69-4ea7-a0b9-42c4f44675d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:59:10.259779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0744ac-0c69-4ea7-a0b9-42c4f44675d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:59:10.261169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0744ac-0c69-4ea7-a0b9-42c4f44675d9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:59:10.280033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 646/1306] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 00:59:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:59:20.117404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=30 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:20.275848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:14.218957 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc47bfa-fd2c-4bbc-a920-c635fcc5a447 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:14.220296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc47bfa-fd2c-4bbc-a920-c635fcc5a447 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:14.221006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc47bfa-fd2c-4bbc-a920-c635fcc5a447 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:14.239818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d59d4b-e290-4102-ba6a-75d6005e1bde None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:14.240258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d59d4b-e290-4102-ba6a-75d6005e1bde None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:14.240631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d59d4b-e290-4102-ba6a-75d6005e1bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:14.246905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 661/1307] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:14 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:14.430622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-54d59d4b-e290-4102-ba6a-75d6005e1bde None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:14.432101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-54d59d4b-e290-4102-ba6a-75d6005e1bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:14.562520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 647/1308] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:14.860403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce22e9-5556-4fe0-b738-88e66df15c91 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:14.860731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce22e9-5556-4fe0-b738-88e66df15c91 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:14.860972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce22e9-5556-4fe0-b738-88e66df15c91 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:14.863033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 662/1309] 10.222.0.83 () {54 vars in 965 bytes} [Wed Aug 31 01:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:14.869456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3ac28-13dd-40e8-b558-5a555010d1da None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:14.869818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3ac28-13dd-40e8-b558-5a555010d1da None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:14.870168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3ac28-13dd-40e8-b558-5a555010d1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:14.949440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4df3ac28-13dd-40e8-b558-5a555010d1da None None] MFA Rules not processed for user `f6c13711596647178ad3f93865eca187`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:14.950650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4df3ac28-13dd-40e8-b558-5a555010d1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:14.971780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:15.032836 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 648/1310] 10.222.0.83 () {58 vars in 1062 bytes} [Wed Aug 31 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:15.041982 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce22e9-5556-4fe0-b738-88e66df15c91 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:15.043770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-59ce22e9-5556-4fe0-b738-88e66df15c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:15.179445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce22e9-5556-4fe0-b738-88e66df15c91 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:15.263876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaed9b-a0f0-48b4-a385-f43a883efb76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:15.264588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaed9b-a0f0-48b4-a385-f43a883efb76 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:15.264883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaed9b-a0f0-48b4-a385-f43a883efb76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:15.265058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaed9b-a0f0-48b4-a385-f43a883efb76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:15.266641 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9ccaed9b-a0f0-48b4-a385-f43a883efb76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:15.323878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:15.384427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaed9b-a0f0-48b4-a385-f43a883efb76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:15.385975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaed9b-a0f0-48b4-a385-f43a883efb76 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:15.407018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 663/1311] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:17.688151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ed130-e465-4488-9914-ecef3b6b388a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:17.688778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ed130-e465-4488-9914-ecef3b6b388a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:17.688778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ed130-e465-4488-9914-ecef3b6b388a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:17.690430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 649/1312] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:17.696016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51c42-fc89-4d79-b530-6e7da72fdf06 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:17.696590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51c42-fc89-4d79-b530-6e7da72fdf06 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:17.696681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51c42-fc89-4d79-b530-6e7da72fdf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:17.785020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c5e51c42-fc89-4d79-b530-6e7da72fdf06 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:17.786396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c5e51c42-fc89-4d79-b530-6e7da72fdf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:17.890842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 664/1313] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:18.171975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ed130-e465-4488-9914-ecef3b6b388a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:18.173556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8e2ed130-e465-4488-9914-ecef3b6b388a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:18.277094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ed130-e465-4488-9914-ecef3b6b388a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:18.347570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:18.350360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60794c3-cb7e-48a1-9d13-437a253d5782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:18.351013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60794c3-cb7e-48a1-9d13-437a253d5782 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:18.351487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60794c3-cb7e-48a1-9d13-437a253d5782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:18.351983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60794c3-cb7e-48a1-9d13-437a253d5782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:18.353863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f60794c3-cb7e-48a1-9d13-437a253d5782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:18.462600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60794c3-cb7e-48a1-9d13-437a253d5782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:18.464407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60794c3-cb7e-48a1-9d13-437a253d5782 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:18.482638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 650/1314] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:20.680384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcfba1-081c-4ebf-9ba1-4567e1f43384 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:20.680975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcfba1-081c-4ebf-9ba1-4567e1f43384 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:20.680975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcfba1-081c-4ebf-9ba1-4567e1f43384 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:20.682266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 665/1315] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:20.687374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e60a1-e729-4746-9d72-820bb0dc8db7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:20.687800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e60a1-e729-4746-9d72-820bb0dc8db7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:20.687934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e60a1-e729-4746-9d72-820bb0dc8db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:20.754113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-801e60a1-e729-4746-9d72-820bb0dc8db7 None None] MFA Rules not processed for user `2e97a0404fba471486325b37a982a862`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:20.755322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-801e60a1-e729-4746-9d72-820bb0dc8db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:20.806107 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:20.850316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 651/1316] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:21.134212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcfba1-081c-4ebf-9ba1-4567e1f43384 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:21.135738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1cbcfba1-081c-4ebf-9ba1-4567e1f43384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:21.145870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:21.240438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcfba1-081c-4ebf-9ba1-4567e1f43384 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:21.311279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece05659-96d5-42cc-85a8-6e61675a251f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:21.311881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece05659-96d5-42cc-85a8-6e61675a251f service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:21.312161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece05659-96d5-42cc-85a8-6e61675a251f service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:21.312463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece05659-96d5-42cc-85a8-6e61675a251f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:21.314048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ece05659-96d5-42cc-85a8-6e61675a251f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:21.374940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:21.420604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece05659-96d5-42cc-85a8-6e61675a251f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:21.422032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece05659-96d5-42cc-85a8-6e61675a251f service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:21.442080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 666/1317] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:23.932815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3a98-0585-4f05-923e-595364e197dd None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:23.933380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3a98-0585-4f05-923e-595364e197dd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:23.933380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3a98-0585-4f05-923e-595364e197dd None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:23.934716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 652/1318] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:23.939935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009dc3-be06-4147-8c9c-a4e2042a3b40 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:23.940448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009dc3-be06-4147-8c9c-a4e2042a3b40 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:23.940590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009dc3-be06-4147-8c9c-a4e2042a3b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:24.005144 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c8009dc3-be06-4147-8c9c-a4e2042a3b40 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:24.006329 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c8009dc3-be06-4147-8c9c-a4e2042a3b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:24.100915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 667/1319] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:24.405957 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd3a98-0585-4f05-923e-595364e197dd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:24.407507 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f8cd3a98-0585-4f05-923e-595364e197dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:24.511581 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd3a98-0585-4f05-923e-595364e197dd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:24.590127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc225e-f010-4779-9350-f6fe4728c23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:24.590738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc225e-f010-4779-9350-f6fe4728c23b service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:24.591021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc225e-f010-4779-9350-f6fe4728c23b service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:24.591295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc225e-f010-4779-9350-f6fe4728c23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:24.592922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-00dc225e-f010-4779-9350-f6fe4728c23b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:24.600506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:24.703502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc225e-f010-4779-9350-f6fe4728c23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:24.704895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc225e-f010-4779-9350-f6fe4728c23b service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:24.723469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 653/1320] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:27.282750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536830-b6a3-4ed0-ac6d-c772be63cb02 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:27.283320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536830-b6a3-4ed0-ac6d-c772be63cb02 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:27.283320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536830-b6a3-4ed0-ac6d-c772be63cb02 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:27.285166 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 668/1321] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 01:00:27.290538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982b50b-2447-406b-9967-bb5f68bd5386 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:27.290968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982b50b-2447-406b-9967-bb5f68bd5386 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:27.291106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982b50b-2447-406b-9967-bb5f68bd5386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:27.357990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5982b50b-2447-406b-9967-bb5f68bd5386 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:27.359213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5982b50b-2447-406b-9967-bb5f68bd5386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:27.418837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:27.460245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 654/1322] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:27.755898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536830-b6a3-4ed0-ac6d-c772be63cb02 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:27.757453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-85536830-b6a3-4ed0-ac6d-c772be63cb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:27.777804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:27.864154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536830-b6a3-4ed0-ac6d-c772be63cb02 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:27.937735 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73461dc-b2d4-4a4e-b4a1-2ae0695443e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:27.938232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73461dc-b2d4-4a4e-b4a1-2ae0695443e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:27.938507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73461dc-b2d4-4a4e-b4a1-2ae0695443e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:27.938775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73461dc-b2d4-4a4e-b4a1-2ae0695443e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:27.940426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a73461dc-b2d4-4a4e-b4a1-2ae0695443e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:28.011999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:28.051959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73461dc-b2d4-4a4e-b4a1-2ae0695443e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:28.053702 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73461dc-b2d4-4a4e-b4a1-2ae0695443e0 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:28.071712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 669/1323] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:30.082146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618078-5a1b-4482-b6b7-8a5e00a16639 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:30.082680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618078-5a1b-4482-b6b7-8a5e00a16639 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:30.082680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618078-5a1b-4482-b6b7-8a5e00a16639 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:30.083944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 655/1324] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:30.089447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49648-f60c-44c9-89bd-360a153b8887 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:30.089902 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49648-f60c-44c9-89bd-360a153b8887 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:30.090007 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49648-f60c-44c9-89bd-360a153b8887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:30.160156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a2c49648-f60c-44c9-89bd-360a153b8887 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:30.161429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a2c49648-f60c-44c9-89bd-360a153b8887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:30.258038 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 670/1325] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:30.541986 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89618078-5a1b-4482-b6b7-8a5e00a16639 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:30.543596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-89618078-5a1b-4482-b6b7-8a5e00a16639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:30.661338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89618078-5a1b-4482-b6b7-8a5e00a16639 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:30.733920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f39f39-9c75-4e1e-99ce-2485ab03d296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:30.734530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f39f39-9c75-4e1e-99ce-2485ab03d296 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:30.734808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f39f39-9c75-4e1e-99ce-2485ab03d296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:30.735082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f39f39-9c75-4e1e-99ce-2485ab03d296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:30.737324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-37f39f39-9c75-4e1e-99ce-2485ab03d296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:30.754668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:30.851043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f39f39-9c75-4e1e-99ce-2485ab03d296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:30.852513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f39f39-9c75-4e1e-99ce-2485ab03d296 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:30.871826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 656/1326] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:32.847201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff5965-0e44-41d5-a3be-41d3360d60a5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:32.847829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff5965-0e44-41d5-a3be-41d3360d60a5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:32.847829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff5965-0e44-41d5-a3be-41d3360d60a5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:32.849171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 671/1327] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:32.855047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa252f-9ed3-472a-8926-8489c3934eea None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:32.855595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa252f-9ed3-472a-8926-8489c3934eea None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:32.855595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa252f-9ed3-472a-8926-8489c3934eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:32.921811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b7aa252f-9ed3-472a-8926-8489c3934eea None None] MFA Rules not processed for user `2e97a0404fba471486325b37a982a862`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:32.923004 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b7aa252f-9ed3-472a-8926-8489c3934eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:32.988154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:33.021729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 657/1328] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:33.309853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff5965-0e44-41d5-a3be-41d3360d60a5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:33.311469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-14ff5965-0e44-41d5-a3be-41d3360d60a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:33.347595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:33.421929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff5965-0e44-41d5-a3be-41d3360d60a5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:33.494227 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7dfbb-6335-48f2-9811-9c9fa4a693da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:33.494768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7dfbb-6335-48f2-9811-9c9fa4a693da service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:33.495051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7dfbb-6335-48f2-9811-9c9fa4a693da service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:33.495345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7dfbb-6335-48f2-9811-9c9fa4a693da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:33.496952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-84d7dfbb-6335-48f2-9811-9c9fa4a693da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:33.573575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:33.605052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7dfbb-6335-48f2-9811-9c9fa4a693da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:33.606405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7dfbb-6335-48f2-9811-9c9fa4a693da service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:33.624389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 672/1329] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:35.782876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183672ed-316e-42de-824d-effb1d8ea293 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:35.783496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183672ed-316e-42de-824d-effb1d8ea293 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:35.783496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183672ed-316e-42de-824d-effb1d8ea293 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:35.784941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 658/1330] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:35.790171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548aab2-568e-4da6-bac8-72a288293e46 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:35.790582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548aab2-568e-4da6-bac8-72a288293e46 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:35.790731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548aab2-568e-4da6-bac8-72a288293e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:35.858187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5548aab2-568e-4da6-bac8-72a288293e46 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:35.859393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5548aab2-568e-4da6-bac8-72a288293e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:35.955739 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 673/1331] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:36.238585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183672ed-316e-42de-824d-effb1d8ea293 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:36.240127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-183672ed-316e-42de-824d-effb1d8ea293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:36.341683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183672ed-316e-42de-824d-effb1d8ea293 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:36.414395 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e224cf3-0fcd-43d7-9052-a2af1af58e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:36.415004 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224cf3-0fcd-43d7-9052-a2af1af58e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:36.415287 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224cf3-0fcd-43d7-9052-a2af1af58e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:36.415560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224cf3-0fcd-43d7-9052-a2af1af58e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:36.417188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2e224cf3-0fcd-43d7-9052-a2af1af58e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:36.444387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:36.525566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224cf3-0fcd-43d7-9052-a2af1af58e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:36.527024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224cf3-0fcd-43d7-9052-a2af1af58e0a service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:36.545591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 659/1332] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:38.518097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f7093-dd56-4075-8a17-a59fe712139f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:38.518661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f7093-dd56-4075-8a17-a59fe712139f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:38.518661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f7093-dd56-4075-8a17-a59fe712139f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:38.520017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 674/1333] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:38.525277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61863b-f1ac-4459-8c9f-0a515f75e7b3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:38.525730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61863b-f1ac-4459-8c9f-0a515f75e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:38.525829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61863b-f1ac-4459-8c9f-0a515f75e7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:38.590078 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ab61863b-f1ac-4459-8c9f-0a515f75e7b3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:38.591273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ab61863b-f1ac-4459-8c9f-0a515f75e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:38.665969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:38.690127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 660/1334] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:38.976445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f7093-dd56-4075-8a17-a59fe712139f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:38.977993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-047f7093-dd56-4075-8a17-a59fe712139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:39.016604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:39.079852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f7093-dd56-4075-8a17-a59fe712139f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:39.152054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9b852-355c-4cc7-8a95-30cdbd3597b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:39.152697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9b852-355c-4cc7-8a95-30cdbd3597b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:39.152980 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9b852-355c-4cc7-8a95-30cdbd3597b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:39.153257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9b852-355c-4cc7-8a95-30cdbd3597b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:39.154843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-81e9b852-355c-4cc7-8a95-30cdbd3597b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:39.237606 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:39.262633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9b852-355c-4cc7-8a95-30cdbd3597b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:39.264079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9b852-355c-4cc7-8a95-30cdbd3597b8 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:39.281707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 675/1335] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:41.539907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bc006-bffb-4ecb-865a-6285c6c426d9 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:41.540470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bc006-bffb-4ecb-865a-6285c6c426d9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:41.540470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bc006-bffb-4ecb-865a-6285c6c426d9 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:41.541835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 661/1336] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:41.547071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ee4fd-3c21-4ad4-b7d5-5be7e6713007 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:41.547450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ee4fd-3c21-4ad4-b7d5-5be7e6713007 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:41.547628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ee4fd-3c21-4ad4-b7d5-5be7e6713007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:41.612455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6a0ee4fd-3c21-4ad4-b7d5-5be7e6713007 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:41.613655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6a0ee4fd-3c21-4ad4-b7d5-5be7e6713007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:41.709210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 676/1337] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:41.989269 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bc006-bffb-4ecb-865a-6285c6c426d9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:41.990810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a35bc006-bffb-4ecb-865a-6285c6c426d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:42.090803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bc006-bffb-4ecb-865a-6285c6c426d9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:42.162372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9947b0c-d19e-4548-abdf-78b312d7fd37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:42.162981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947b0c-d19e-4548-abdf-78b312d7fd37 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:42.163261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947b0c-d19e-4548-abdf-78b312d7fd37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:42.163533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947b0c-d19e-4548-abdf-78b312d7fd37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:42.165157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b9947b0c-d19e-4548-abdf-78b312d7fd37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:42.199408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:42.273282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9947b0c-d19e-4548-abdf-78b312d7fd37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:42.274647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9947b0c-d19e-4548-abdf-78b312d7fd37 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:42.292541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 662/1338] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:46.155564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd33656-a307-4f62-9a02-0de12c6d547a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:46.156030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd33656-a307-4f62-9a02-0de12c6d547a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:46.156154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd33656-a307-4f62-9a02-0de12c6d547a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:46.157656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 677/1339] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:46.162915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815549-cbaa-4acc-9c1a-8a5b97928b04 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:46.163335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815549-cbaa-4acc-9c1a-8a5b97928b04 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:46.163490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815549-cbaa-4acc-9c1a-8a5b97928b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:46.230631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ab815549-cbaa-4acc-9c1a-8a5b97928b04 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:46.231840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ab815549-cbaa-4acc-9c1a-8a5b97928b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:46.325012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:46.337872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 663/1340] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:46.645382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c215f4f-ea83-4629-89ce-b1f7b0bc1c99 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:46.645669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c215f4f-ea83-4629-89ce-b1f7b0bc1c99 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:46.645944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c215f4f-ea83-4629-89ce-b1f7b0bc1c99 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:46.647283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 678/1341] 10.222.0.83 () {54 vars in 965 bytes} [Wed Aug 31 01:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:46.653204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ec7a-db29-4e16-8744-a6c4ae23f571 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:46.653494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ec7a-db29-4e16-8744-a6c4ae23f571 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:46.653774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ec7a-db29-4e16-8744-a6c4ae23f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:46.730292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ace6ec7a-db29-4e16-8744-a6c4ae23f571 None None] MFA Rules not processed for user `f6c13711596647178ad3f93865eca187`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:46.731484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ace6ec7a-db29-4e16-8744-a6c4ae23f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:46.806559 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 664/1342] 10.222.0.83 () {58 vars in 1062 bytes} [Wed Aug 31 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:46.816026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c215f4f-ea83-4629-89ce-b1f7b0bc1c99 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:46.817575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5c215f4f-ea83-4629-89ce-b1f7b0bc1c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:46.865948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:46.922568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c215f4f-ea83-4629-89ce-b1f7b0bc1c99 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:46.997028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b5ec7-01ad-4ba6-b338-9b818f415b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:46.997631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b5ec7-01ad-4ba6-b338-9b818f415b7f service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:46.997910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b5ec7-01ad-4ba6-b338-9b818f415b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:46.998180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b5ec7-01ad-4ba6-b338-9b818f415b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:46.999792 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ba0b5ec7-01ad-4ba6-b338-9b818f415b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:47.092427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:47.109925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b5ec7-01ad-4ba6-b338-9b818f415b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:47.111890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b5ec7-01ad-4ba6-b338-9b818f415b7f service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:47.131572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 679/1343] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:50.266450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cedde-be4b-4e55-80d5-6ffd8d99d40f None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:50.267035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cedde-be4b-4e55-80d5-6ffd8d99d40f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:50.267035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cedde-be4b-4e55-80d5-6ffd8d99d40f None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:50.268674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 665/1344] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:50.273707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b9c3a-1f46-41d4-9d52-191e92a7d159 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:50.274167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b9c3a-1f46-41d4-9d52-191e92a7d159 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:50.274277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b9c3a-1f46-41d4-9d52-191e92a7d159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:50.347930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ae0b9c3a-1f46-41d4-9d52-191e92a7d159 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:50.349178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ae0b9c3a-1f46-41d4-9d52-191e92a7d159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:50.447753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 680/1345] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:00:50.742468 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cedde-be4b-4e55-80d5-6ffd8d99d40f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:50.744022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-350cedde-be4b-4e55-80d5-6ffd8d99d40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:50.835324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:50.854851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cedde-be4b-4e55-80d5-6ffd8d99d40f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:50.928596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1fa45-dd50-4532-afd8-e142e57b9d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:50.929215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1fa45-dd50-4532-afd8-e142e57b9d4d service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:50.929501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1fa45-dd50-4532-afd8-e142e57b9d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:50.929782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1fa45-dd50-4532-afd8-e142e57b9d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:50.931383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d1b1fa45-dd50-4532-afd8-e142e57b9d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:51.055613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1fa45-dd50-4532-afd8-e142e57b9d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:51.058781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1fa45-dd50-4532-afd8-e142e57b9d4d service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:51.079697 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 666/1346] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:00:55.245283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0fbec-d97a-4d01-9167-efe9ef4b0453 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:55.245817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0fbec-d97a-4d01-9167-efe9ef4b0453 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:55.245817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0fbec-d97a-4d01-9167-efe9ef4b0453 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:55.247194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 681/1347] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:00:55.253793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a974b-6f9a-4375-ab2d-a8f01b941d21 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:55.254286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a974b-6f9a-4375-ab2d-a8f01b941d21 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:55.254382 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a974b-6f9a-4375-ab2d-a8f01b941d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:55.270771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:55.328579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a75a974b-6f9a-4375-ab2d-a8f01b941d21 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:00:55.329859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a75a974b-6f9a-4375-ab2d-a8f01b941d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:55.430301 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 667/1348] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:00:55.711315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0fbec-d97a-4d01-9167-efe9ef4b0453 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:00:55.712872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-26e0fbec-d97a-4d01-9167-efe9ef4b0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:55.771281 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:55.817228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0fbec-d97a-4d01-9167-efe9ef4b0453 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:00:55.889492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054f6d-7794-4733-9dd5-e595477a63f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:00:55.890097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054f6d-7794-4733-9dd5-e595477a63f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:00:55.890378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054f6d-7794-4733-9dd5-e595477a63f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:00:55.890653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054f6d-7794-4733-9dd5-e595477a63f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:00:55.892249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ec054f6d-7794-4733-9dd5-e595477a63f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:00:56.000711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:56.006935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054f6d-7794-4733-9dd5-e595477a63f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:00:56.008401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054f6d-7794-4733-9dd5-e595477a63f7 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:00:56.026666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 682/1349] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:00.996262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e836f59-da53-424e-bdb4-f795b0dd9803 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:00.996781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e836f59-da53-424e-bdb4-f795b0dd9803 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:00.996867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e836f59-da53-424e-bdb4-f795b0dd9803 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:00.998530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 668/1350] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:01.004703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931188e3-46e1-4088-8822-8b871ca32580 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:01.005618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931188e3-46e1-4088-8822-8b871ca32580 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:01.005847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931188e3-46e1-4088-8822-8b871ca32580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:01.101875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-931188e3-46e1-4088-8822-8b871ca32580 None None] MFA Rules not processed for user `1eb93baf45174c10a6fcbe321ac65764`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:01.103446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-931188e3-46e1-4088-8822-8b871ca32580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:01.271849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 683/1351] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:01:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:05.428583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=59 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:05.594943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596cd6-89d2-481c-9023-c35b6d4cafaf None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:05.595248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596cd6-89d2-481c-9023-c35b6d4cafaf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:05.595844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596cd6-89d2-481c-9023-c35b6d4cafaf None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:05.597544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 669/1352] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:05.602579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7225b-6cc2-4a15-98d2-f61a7ce34b1f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:05.603043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7225b-6cc2-4a15-98d2-f61a7ce34b1f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:05.603147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7225b-6cc2-4a15-98d2-f61a7ce34b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:05.658539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:05.683173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ccc7225b-6cc2-4a15-98d2-f61a7ce34b1f None None] MFA Rules not processed for user `1eb93baf45174c10a6fcbe321ac65764`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:05.684546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ccc7225b-6cc2-4a15-98d2-f61a7ce34b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:05.796421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 684/1353] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:07.155721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd388cc-176a-415e-8d67-f803394373cd None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:07.156158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd388cc-176a-415e-8d67-f803394373cd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:07.156281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd388cc-176a-415e-8d67-f803394373cd None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:07.157663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 670/1354] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:07.163041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399c9b-9b1d-430e-a1fc-699b570d1ab2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:07.163515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399c9b-9b1d-430e-a1fc-699b570d1ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:07.163614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399c9b-9b1d-430e-a1fc-699b570d1ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:07.240160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2f399c9b-9b1d-430e-a1fc-699b570d1ab2 None None] MFA Rules not processed for user `1eb93baf45174c10a6fcbe321ac65764`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:07.241395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2f399c9b-9b1d-430e-a1fc-699b570d1ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:07.281762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:07.348496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 685/1355] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:10.702018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c9edf-1cc7-4d2c-bd62-9f3d457bb342 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:10.702588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c9edf-1cc7-4d2c-bd62-9f3d457bb342 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:10.702588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c9edf-1cc7-4d2c-bd62-9f3d457bb342 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:10.703975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 671/1356] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:10.709821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42e9f-5ae3-456c-acc7-97187b95c9db None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:10.710251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42e9f-5ae3-456c-acc7-97187b95c9db None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:10.710510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42e9f-5ae3-456c-acc7-97187b95c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:10.791885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1af42e9f-5ae3-456c-acc7-97187b95c9db None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:10.793135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1af42e9f-5ae3-456c-acc7-97187b95c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:10.919140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 686/1357] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:11.232025 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8daa-f2d0-41d4-9eb5-5028f09ed9a4 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:11.232975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8daa-f2d0-41d4-9eb5-5028f09ed9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:11.233499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8daa-f2d0-41d4-9eb5-5028f09ed9a4 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:11.235531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 672/1358] 10.222.0.83 () {54 vars in 962 bytes} [Wed Aug 31 01:01:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:11.243693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a81f8-b1ff-45d6-afd3-08780cee5e78 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:11.244096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a81f8-b1ff-45d6-afd3-08780cee5e78 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:11.244282 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a81f8-b1ff-45d6-afd3-08780cee5e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:11.269296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:11.366657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c80a81f8-b1ff-45d6-afd3-08780cee5e78 None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:11.367945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c80a81f8-b1ff-45d6-afd3-08780cee5e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:11.489386 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 687/1359] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Aug 31 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:11.503718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8daa-f2d0-41d4-9eb5-5028f09ed9a4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:11.505504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2eca8daa-f2d0-41d4-9eb5-5028f09ed9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:11.665049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8daa-f2d0-41d4-9eb5-5028f09ed9a4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:11.743841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:11.787770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d07a-cae7-4bf0-9465-a0a40cfb34e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:11.788413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d07a-cae7-4bf0-9465-a0a40cfb34e3 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:11.788707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d07a-cae7-4bf0-9465-a0a40cfb34e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:11.788976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d07a-cae7-4bf0-9465-a0a40cfb34e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:11.790613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8579d07a-cae7-4bf0-9465-a0a40cfb34e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:11.885845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d07a-cae7-4bf0-9465-a0a40cfb34e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:11.887439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d07a-cae7-4bf0-9465-a0a40cfb34e3 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:11.907330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 673/1360] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:14.078852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb361992-b2a5-48d5-98d7-525787099afc None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:14.079351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb361992-b2a5-48d5-98d7-525787099afc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:14.079351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb361992-b2a5-48d5-98d7-525787099afc None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:14.081144 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 688/1361] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:14.086277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9edda-5381-4960-b2d6-bbb2a3a99698 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:14.086689 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9edda-5381-4960-b2d6-bbb2a3a99698 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:14.086837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9edda-5381-4960-b2d6-bbb2a3a99698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:14.165272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f6c9edda-5381-4960-b2d6-bbb2a3a99698 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:14.166849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f6c9edda-5381-4960-b2d6-bbb2a3a99698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:14.209652 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:14.287417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 674/1362] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:01:14.593293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb361992-b2a5-48d5-98d7-525787099afc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:14.595065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bb361992-b2a5-48d5-98d7-525787099afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:14.674905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:14.761057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb361992-b2a5-48d5-98d7-525787099afc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:14.883877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34c0f1-baaa-4a4e-bac3-554374de34c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:14.884793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34c0f1-baaa-4a4e-bac3-554374de34c4 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:14.885074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34c0f1-baaa-4a4e-bac3-554374de34c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:14.885345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34c0f1-baaa-4a4e-bac3-554374de34c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:14.886942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dd34c0f1-baaa-4a4e-bac3-554374de34c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:14.914849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:14.989971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34c0f1-baaa-4a4e-bac3-554374de34c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:14.991581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34c0f1-baaa-4a4e-bac3-554374de34c4 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:15.011430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 689/1363] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:17.293585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51905-238f-4ec8-b7c8-5e12f132274d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:17.294483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51905-238f-4ec8-b7c8-5e12f132274d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:17.294762 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51905-238f-4ec8-b7c8-5e12f132274d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:17.296110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 675/1364] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:17.301783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eadef3-1641-47e4-9c35-96da7da36926 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:17.302238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eadef3-1641-47e4-9c35-96da7da36926 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:17.302325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eadef3-1641-47e4-9c35-96da7da36926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:17.382572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-10eadef3-1641-47e4-9c35-96da7da36926 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:17.384153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-10eadef3-1641-47e4-9c35-96da7da36926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:17.493197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:17.500426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 690/1365] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:17.794566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcad4b-7faa-44e2-8112-60779c894998 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:17.794980 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcad4b-7faa-44e2-8112-60779c894998 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:17.795363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcad4b-7faa-44e2-8112-60779c894998 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:17.796993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 676/1366] 10.222.0.83 () {54 vars in 962 bytes} [Wed Aug 31 01:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:17.802931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa4f5-db5c-460f-9a79-a78c23677da4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:17.803231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa4f5-db5c-460f-9a79-a78c23677da4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:17.803510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa4f5-db5c-460f-9a79-a78c23677da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:17.882783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-15baa4f5-db5c-460f-9a79-a78c23677da4 None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:17.884526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-15baa4f5-db5c-460f-9a79-a78c23677da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:18.014301 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 691/1367] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Aug 31 01:01:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:18.023041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcad4b-7faa-44e2-8112-60779c894998 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:18.024852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e5dcad4b-7faa-44e2-8112-60779c894998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:18.189857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcad4b-7faa-44e2-8112-60779c894998 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:18.211956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:18.312470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76477e-b0db-4157-922f-692477b82754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:18.313151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76477e-b0db-4157-922f-692477b82754 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:18.313433 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76477e-b0db-4157-922f-692477b82754 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:18.313599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76477e-b0db-4157-922f-692477b82754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:18.315419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1e76477e-b0db-4157-922f-692477b82754 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:18.417068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76477e-b0db-4157-922f-692477b82754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:18.418577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76477e-b0db-4157-922f-692477b82754 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:18.438363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 677/1368] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:19.018385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d883d3-e784-4460-949b-75be25c12e1f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:19.018973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d883d3-e784-4460-949b-75be25c12e1f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:19.018973 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d883d3-e784-4460-949b-75be25c12e1f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:19.020522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 692/1369] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:19.025843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84319bff-2480-4c63-aa1b-0bc13218d37f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:19.026241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84319bff-2480-4c63-aa1b-0bc13218d37f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:19.026623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84319bff-2480-4c63-aa1b-0bc13218d37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:19.061312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:19.100351 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-84319bff-2480-4c63-aa1b-0bc13218d37f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:19.101691 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-84319bff-2480-4c63-aa1b-0bc13218d37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:19.211370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 678/1370] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:19.770719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de111-2283-4551-9aea-7d73575cd971 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:19.771011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de111-2283-4551-9aea-7d73575cd971 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:19.771294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de111-2283-4551-9aea-7d73575cd971 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:19.772829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 693/1371] 10.222.0.83 () {54 vars in 964 bytes} [Wed Aug 31 01:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:19.777723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dadbea-744a-40c9-b975-fc47722eff7e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:19.778165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dadbea-744a-40c9-b975-fc47722eff7e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:19.778264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dadbea-744a-40c9-b975-fc47722eff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:19.857558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a6dadbea-744a-40c9-b975-fc47722eff7e None None] MFA Rules not processed for user `376dd413b33c4f4987f6bba3b14f3bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:19.858783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a6dadbea-744a-40c9-b975-fc47722eff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:19.913439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:19.947142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 679/1372] 10.222.0.83 () {58 vars in 1061 bytes} [Wed Aug 31 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:19.954814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de111-2283-4551-9aea-7d73575cd971 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:19.956398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7c6de111-2283-4551-9aea-7d73575cd971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:20.023861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:20.080903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de111-2283-4551-9aea-7d73575cd971 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:20.178364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c52fa-b91e-4ec1-a485-516e5ed09b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:20.179237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c52fa-b91e-4ec1-a485-516e5ed09b65 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:20.179527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c52fa-b91e-4ec1-a485-516e5ed09b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:20.179805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c52fa-b91e-4ec1-a485-516e5ed09b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:20.181468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cc5c52fa-b91e-4ec1-a485-516e5ed09b65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:20.305257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:20.324442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c52fa-b91e-4ec1-a485-516e5ed09b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:20.326036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c52fa-b91e-4ec1-a485-516e5ed09b65 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:20.359926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 694/1373] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:20.460882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b66c37-bc5a-4d50-ba64-c6895996f11a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:20.460882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b66c37-bc5a-4d50-ba64-c6895996f11a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:20.460882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b66c37-bc5a-4d50-ba64-c6895996f11a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:20.463885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 680/1374] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:20.469750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487900-4a7f-4872-8449-333d2ce0cef9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:20.470872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487900-4a7f-4872-8449-333d2ce0cef9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:20.471328 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487900-4a7f-4872-8449-333d2ce0cef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:20.569202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-59487900-4a7f-4872-8449-333d2ce0cef9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:20.570427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-59487900-4a7f-4872-8449-333d2ce0cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:20.669223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 695/1375] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:20.955844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b66c37-bc5a-4d50-ba64-c6895996f11a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:20.957399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-60b66c37-bc5a-4d50-ba64-c6895996f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:21.115555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b66c37-bc5a-4d50-ba64-c6895996f11a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:21.171407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:21.234667 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dc83c-bbc0-4172-a552-7d87dc58fc8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:21.235208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc83c-bbc0-4172-a552-7d87dc58fc8f service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:21.235484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc83c-bbc0-4172-a552-7d87dc58fc8f service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:21.235872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc83c-bbc0-4172-a552-7d87dc58fc8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:21.237505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8f0dc83c-bbc0-4172-a552-7d87dc58fc8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:21.328962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dc83c-bbc0-4172-a552-7d87dc58fc8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:21.331382 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dc83c-bbc0-4172-a552-7d87dc58fc8f service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:21.358280 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 681/1376] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:23.311316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272231b9-f20c-4118-8138-26208e2a624c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:23.311886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272231b9-f20c-4118-8138-26208e2a624c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:23.311886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272231b9-f20c-4118-8138-26208e2a624c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:23.313228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 696/1377] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:23.318369 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201d50-7a61-476a-be66-0bd2bd1a3802 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:23.318780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201d50-7a61-476a-be66-0bd2bd1a3802 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:23.318920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201d50-7a61-476a-be66-0bd2bd1a3802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:23.392989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-97201d50-7a61-476a-be66-0bd2bd1a3802 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:23.394376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-97201d50-7a61-476a-be66-0bd2bd1a3802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:23.412298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:23.512162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 682/1378] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:23.807942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272231b9-f20c-4118-8138-26208e2a624c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:23.809565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-272231b9-f20c-4118-8138-26208e2a624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:23.900083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:24.021237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272231b9-f20c-4118-8138-26208e2a624c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:24.155149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819fc8d-4d6e-4eb2-8519-0c4b485bb716 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:24.156038 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819fc8d-4d6e-4eb2-8519-0c4b485bb716 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:24.156466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819fc8d-4d6e-4eb2-8519-0c4b485bb716 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:24.156866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819fc8d-4d6e-4eb2-8519-0c4b485bb716 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:24.159393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a819fc8d-4d6e-4eb2-8519-0c4b485bb716 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:24.180976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:24.259029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819fc8d-4d6e-4eb2-8519-0c4b485bb716 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:24.260670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819fc8d-4d6e-4eb2-8519-0c4b485bb716 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:24.279058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 697/1379] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:26.219632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b06d-6652-4137-a789-7d583595acf8 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:26.220769 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b06d-6652-4137-a789-7d583595acf8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:26.221046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b06d-6652-4137-a789-7d583595acf8 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:26.222477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 683/1380] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:26.227723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fcdc3-72c9-418b-a2d2-f772b6d7cd60 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:26.228149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fcdc3-72c9-418b-a2d2-f772b6d7cd60 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:26.228300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fcdc3-72c9-418b-a2d2-f772b6d7cd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:26.306451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cc2fcdc3-72c9-418b-a2d2-f772b6d7cd60 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:26.308147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cc2fcdc3-72c9-418b-a2d2-f772b6d7cd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:26.414297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:26.421217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 698/1381] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:26.711658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b06d-6652-4137-a789-7d583595acf8 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:26.713825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7dc3b06d-6652-4137-a789-7d583595acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:26.887241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:26.896394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b06d-6652-4137-a789-7d583595acf8 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:27.028724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cd5aa-9c02-4727-ad6f-30032986b038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:27.029403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cd5aa-9c02-4727-ad6f-30032986b038 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:27.030636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cd5aa-9c02-4727-ad6f-30032986b038 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:27.030636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cd5aa-9c02-4727-ad6f-30032986b038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:27.031796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bf7cd5aa-9c02-4727-ad6f-30032986b038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:27.130130 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cd5aa-9c02-4727-ad6f-30032986b038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:27.131898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cd5aa-9c02-4727-ad6f-30032986b038 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:27.144122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:27.157082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 684/1382] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:29.431578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aac389-4a35-4354-92df-2fa90f9cc7c4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:29.432279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aac389-4a35-4354-92df-2fa90f9cc7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:29.432279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aac389-4a35-4354-92df-2fa90f9cc7c4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:29.433613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 699/1383] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 01:01:29.443667 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1368f-a872-4503-a30a-366350d74cbf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:29.444219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1368f-a872-4503-a30a-366350d74cbf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:29.444454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1368f-a872-4503-a30a-366350d74cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:29.523327 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e7f1368f-a872-4503-a30a-366350d74cbf None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:29.524458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e7f1368f-a872-4503-a30a-366350d74cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:29.647320 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 685/1384] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:01:29.996350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aac389-4a35-4354-92df-2fa90f9cc7c4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:29.997983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c0aac389-4a35-4354-92df-2fa90f9cc7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:30.193807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aac389-4a35-4354-92df-2fa90f9cc7c4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:30.267528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:30.316044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf2b72-9f4b-4459-9111-13d0173ae321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:30.316677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2b72-9f4b-4459-9111-13d0173ae321 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:30.316915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2b72-9f4b-4459-9111-13d0173ae321 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:30.317196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2b72-9f4b-4459-9111-13d0173ae321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:30.318788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-29cf2b72-9f4b-4459-9111-13d0173ae321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:30.423721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf2b72-9f4b-4459-9111-13d0173ae321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:30.425344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf2b72-9f4b-4459-9111-13d0173ae321 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:30.444627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 700/1385] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:32.917580 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bf103-e744-4d09-9290-e352ba2ad613 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:32.918177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bf103-e744-4d09-9290-e352ba2ad613 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:32.918177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bf103-e744-4d09-9290-e352ba2ad613 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:32.919489 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 686/1386] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:32.926020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3600e0-3736-44ed-add7-a0fcf87ef19d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:32.926565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3600e0-3736-44ed-add7-a0fcf87ef19d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:32.926565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3600e0-3736-44ed-add7-a0fcf87ef19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:32.994410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2f3600e0-3736-44ed-add7-a0fcf87ef19d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:32.995388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2f3600e0-3736-44ed-add7-a0fcf87ef19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:33.034778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:33.120850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 701/1387] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:01:33.536942 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bf103-e744-4d09-9290-e352ba2ad613 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:33.538505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3a8bf103-e744-4d09-9290-e352ba2ad613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:33.618700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:33.699018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bf103-e744-4d09-9290-e352ba2ad613 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:33.822437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c6201-88bf-4a6a-8b7c-5eedbfb0647c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:33.822978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c6201-88bf-4a6a-8b7c-5eedbfb0647c service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:33.823252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c6201-88bf-4a6a-8b7c-5eedbfb0647c service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:33.823533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c6201-88bf-4a6a-8b7c-5eedbfb0647c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:33.826561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d82c6201-88bf-4a6a-8b7c-5eedbfb0647c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:33.872970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:33.927797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c6201-88bf-4a6a-8b7c-5eedbfb0647c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:33.929447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c6201-88bf-4a6a-8b7c-5eedbfb0647c service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:33.948072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 687/1388] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:01:35.625794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b655-1722-407f-8693-7155bc14dc03 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:35.627014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b655-1722-407f-8693-7155bc14dc03 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:35.627457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b655-1722-407f-8693-7155bc14dc03 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:35.628871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 702/1389] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:35.634270 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a929fe-63bf-4fa2-a7a0-cd7e80c3d940 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:35.634713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a929fe-63bf-4fa2-a7a0-cd7e80c3d940 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:35.634821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a929fe-63bf-4fa2-a7a0-cd7e80c3d940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:35.701860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f3a929fe-63bf-4fa2-a7a0-cd7e80c3d940 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:35.702969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f3a929fe-63bf-4fa2-a7a0-cd7e80c3d940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:35.803881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 688/1390] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:35.892346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b922b-8afc-4a7e-adfd-6b8bcc08ef36 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:35.892652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b922b-8afc-4a7e-adfd-6b8bcc08ef36 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:35.892937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b922b-8afc-4a7e-adfd-6b8bcc08ef36 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:35.894354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 703/1391] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:35.899785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05f0a-448f-477e-8cbd-e1f101a0a754 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:35.900083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05f0a-448f-477e-8cbd-e1f101a0a754 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:35.900393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05f0a-448f-477e-8cbd-e1f101a0a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:35.916745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:35.968992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c2f05f0a-448f-477e-8cbd-e1f101a0a754 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:35.971225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c2f05f0a-448f-477e-8cbd-e1f101a0a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:36.072757 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 689/1392] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:36.104280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee827bdb-ee1c-4780-a394-15c790d0444d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:36.104610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee827bdb-ee1c-4780-a394-15c790d0444d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:36.104912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee827bdb-ee1c-4780-a394-15c790d0444d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:36.106263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 704/1393] 10.222.0.83 () {54 vars in 967 bytes} [Wed Aug 31 01:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:36.112680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27676b-7bd8-4434-aee9-d9529f967995 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:36.112977 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27676b-7bd8-4434-aee9-d9529f967995 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:36.113260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27676b-7bd8-4434-aee9-d9529f967995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:36.198385 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5f27676b-7bd8-4434-aee9-d9529f967995 None None] MFA Rules not processed for user `deb70dd34dc642cfbb49b4e1a0434399`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:36.199596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5f27676b-7bd8-4434-aee9-d9529f967995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:36.237496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:36.286027 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 690/1394] 10.222.0.83 () {58 vars in 1064 bytes} [Wed Aug 31 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:36.293420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee827bdb-ee1c-4780-a394-15c790d0444d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:36.294929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ee827bdb-ee1c-4780-a394-15c790d0444d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:36.382040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27676b-7bd8-4434-aee9-d9529f967995 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:36.383240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5f27676b-7bd8-4434-aee9-d9529f967995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:36.417106 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee827bdb-ee1c-4780-a394-15c790d0444d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:36.488437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:36.505735 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47ad1e-cf37-48a7-a96e-b2616e46bf92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb70dd34dc642cfbb49b4e1a0434399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:36.506350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47ad1e-cf37-48a7-a96e-b2616e46bf92 service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:36.506634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47ad1e-cf37-48a7-a96e-b2616e46bf92 service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:36.506912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47ad1e-cf37-48a7-a96e-b2616e46bf92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:36.508544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7d47ad1e-cf37-48a7-a96e-b2616e46bf92 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:36.520734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27676b-7bd8-4434-aee9-d9529f967995 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:36.584966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:36.619305 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47ad1e-cf37-48a7-a96e-b2616e46bf92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:36.620780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47ad1e-cf37-48a7-a96e-b2616e46bf92 service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:36.637205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43083d-4bcd-4edc-9ed5-6fde581d4a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:36.637876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43083d-4bcd-4edc-9ed5-6fde581d4a5d service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:36.638121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43083d-4bcd-4edc-9ed5-6fde581d4a5d service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:36.638398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43083d-4bcd-4edc-9ed5-6fde581d4a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:36.639930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 705/1395] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:36.640362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cc43083d-4bcd-4edc-9ed5-6fde581d4a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:36.733338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43083d-4bcd-4edc-9ed5-6fde581d4a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:36.734937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43083d-4bcd-4edc-9ed5-6fde581d4a5d service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:36.755864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 691/1396] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:01:37.403501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82095-3a29-4ada-9656-c3f8dbc7b744 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:37.403794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82095-3a29-4ada-9656-c3f8dbc7b744 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:37.404075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82095-3a29-4ada-9656-c3f8dbc7b744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:37.472235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-98b82095-3a29-4ada-9656-c3f8dbc7b744 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:37.473566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-98b82095-3a29-4ada-9656-c3f8dbc7b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:37.514197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:37.562976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 706/1397] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:37.609661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5d2d-7b84-4b70-bc9a-75a6da17af0b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:37.610026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5d2d-7b84-4b70-bc9a-75a6da17af0b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:37.610607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5d2d-7b84-4b70-bc9a-75a6da17af0b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:37.612379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 692/1398] 10.222.0.83 () {54 vars in 943 bytes} [Wed Aug 31 01:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:37.622315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1a506-3593-49b8-9007-1f45ae62f5ec None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:37.622675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1a506-3593-49b8-9007-1f45ae62f5ec None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:37.623367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1a506-3593-49b8-9007-1f45ae62f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:37.698859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-30b1a506-3593-49b8-9007-1f45ae62f5ec None None] MFA Rules not processed for user `814473b735314e4cb2321e952777031c`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:37.700058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-30b1a506-3593-49b8-9007-1f45ae62f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:37.806975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 707/1399] 10.222.0.83 () {58 vars in 1040 bytes} [Wed Aug 31 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:37.816436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5d2d-7b84-4b70-bc9a-75a6da17af0b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:37.817957 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aefb5d2d-7b84-4b70-bc9a-75a6da17af0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:37.895537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:37.959144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5d2d-7b84-4b70-bc9a-75a6da17af0b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:38.066145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03598d1d-7498-415f-a097-09cd5c430e59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:38.066761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03598d1d-7498-415f-a097-09cd5c430e59 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:38.067044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03598d1d-7498-415f-a097-09cd5c430e59 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:38.067317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03598d1d-7498-415f-a097-09cd5c430e59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:38.069005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-03598d1d-7498-415f-a097-09cd5c430e59 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:38.130213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:38.161639 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03598d1d-7498-415f-a097-09cd5c430e59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:38.163307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03598d1d-7498-415f-a097-09cd5c430e59 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:38.171911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 693/1400] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:01:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:01:38.748662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05bcca-678e-41eb-bb86-8d943c20262f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:38.749226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05bcca-678e-41eb-bb86-8d943c20262f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:38.749226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05bcca-678e-41eb-bb86-8d943c20262f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:38.750677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 708/1401] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:38.755841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc747f-9d55-4307-875a-39d03a55e9c5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:38.756168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc747f-9d55-4307-875a-39d03a55e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:38.756499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc747f-9d55-4307-875a-39d03a55e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:38.830089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-06bc747f-9d55-4307-875a-39d03a55e9c5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:38.831325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-06bc747f-9d55-4307-875a-39d03a55e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:38.936108 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 694/1402] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:39.254679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05bcca-678e-41eb-bb86-8d943c20262f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:39.256218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ea05bcca-678e-41eb-bb86-8d943c20262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:39.274266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:39.418127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05bcca-678e-41eb-bb86-8d943c20262f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:39.519835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:39.549582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f894d46-0bdd-442c-a0b4-b078a6119721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:39.550357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894d46-0bdd-442c-a0b4-b078a6119721 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:39.550714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894d46-0bdd-442c-a0b4-b078a6119721 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:39.551046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894d46-0bdd-442c-a0b4-b078a6119721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:39.552780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3f894d46-0bdd-442c-a0b4-b078a6119721 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:39.654265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f894d46-0bdd-442c-a0b4-b078a6119721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:39.655960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f894d46-0bdd-442c-a0b4-b078a6119721 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:39.676097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 709/1403] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:41.644727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26f9b0-4ee2-4291-8698-35c4b52bf554 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:41.645645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26f9b0-4ee2-4291-8698-35c4b52bf554 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:41.645930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26f9b0-4ee2-4291-8698-35c4b52bf554 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:41.647353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 695/1404] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:41.652676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188f165-4cb2-49b2-a222-97b881429c3e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:41.653439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188f165-4cb2-49b2-a222-97b881429c3e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:41.653716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188f165-4cb2-49b2-a222-97b881429c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:41.728723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8188f165-4cb2-49b2-a222-97b881429c3e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:41.730228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8188f165-4cb2-49b2-a222-97b881429c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:41.787258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:41.841231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 710/1405] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:42.141271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26f9b0-4ee2-4291-8698-35c4b52bf554 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:42.143929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6a26f9b0-4ee2-4291-8698-35c4b52bf554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:42.209151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:42.316513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26f9b0-4ee2-4291-8698-35c4b52bf554 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:42.457977 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccae75d-81ba-43f7-a4fe-7611b3abfa3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:42.458598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccae75d-81ba-43f7-a4fe-7611b3abfa3f service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:42.458887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccae75d-81ba-43f7-a4fe-7611b3abfa3f service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:42.459166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccae75d-81ba-43f7-a4fe-7611b3abfa3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:42.460820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1ccae75d-81ba-43f7-a4fe-7611b3abfa3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:42.477132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:42.564901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccae75d-81ba-43f7-a4fe-7611b3abfa3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:42.566653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccae75d-81ba-43f7-a4fe-7611b3abfa3f service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:42.588690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 696/1406] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:44.597211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1562-965f-44af-8917-acba9fe46ffc None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:44.597753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1562-965f-44af-8917-acba9fe46ffc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:44.598228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1562-965f-44af-8917-acba9fe46ffc None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:44.604369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 711/1407] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:01:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:01:44.606475 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bea63-f4c1-4582-ab07-23740e039dad None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:44.607122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bea63-f4c1-4582-ab07-23740e039dad None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:44.607122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bea63-f4c1-4582-ab07-23740e039dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:44.822709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c02bea63-f4c1-4582-ab07-23740e039dad None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:01:44.823956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c02bea63-f4c1-4582-ab07-23740e039dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:44.928673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:44.943187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 697/1408] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:01:45.321182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1562-965f-44af-8917-acba9fe46ffc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:01:45.322703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-834e1562-965f-44af-8917-acba9fe46ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:45.499999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1562-965f-44af-8917-acba9fe46ffc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:01:45.541776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:45.632195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6687463-f8b4-4a34-8ff6-a02bf426a875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:01:45.633629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687463-f8b4-4a34-8ff6-a02bf426a875 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:01:45.633919 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687463-f8b4-4a34-8ff6-a02bf426a875 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:01:45.634202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687463-f8b4-4a34-8ff6-a02bf426a875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:01:45.635823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a6687463-f8b4-4a34-8ff6-a02bf426a875 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:01:45.734772 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6687463-f8b4-4a34-8ff6-a02bf426a875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:01:45.737151 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6687463-f8b4-4a34-8ff6-a02bf426a875 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:01:45.756913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 712/1409] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:01:54.940280 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:55.754344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=83 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:00.566100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464e87-3380-462f-8bbf-c731eb9dc25c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:00.566702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464e87-3380-462f-8bbf-c731eb9dc25c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:00.566702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464e87-3380-462f-8bbf-c731eb9dc25c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:00.567985 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 698/1410] 10.222.0.83 () {54 vars in 918 bytes} [Wed Aug 31 01:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:00.573082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9dafd-e1fd-41b9-b75a-95b7c6bcca57 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:00.573527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9dafd-e1fd-41b9-b75a-95b7c6bcca57 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:00.573630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9dafd-e1fd-41b9-b75a-95b7c6bcca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:00.649955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d9e9dafd-e1fd-41b9-b75a-95b7c6bcca57 None None] MFA Rules not processed for user `1eb93baf45174c10a6fcbe321ac65764`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:00.651146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d9e9dafd-e1fd-41b9-b75a-95b7c6bcca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:00.757765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 713/1411] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Aug 31 01:02:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:00.772213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82d83-5fad-411f-8c98-2db6959f8217 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:00.772590 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82d83-5fad-411f-8c98-2db6959f8217 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:00.772868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82d83-5fad-411f-8c98-2db6959f8217 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:00.774183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 699/1412] 10.222.0.83 () {54 vars in 918 bytes} [Wed Aug 31 01:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:00.778663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05ec6c-db10-4295-8a2b-1e64a7888d0c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:00.778954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05ec6c-db10-4295-8a2b-1e64a7888d0c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:00.779231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05ec6c-db10-4295-8a2b-1e64a7888d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:00.851978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:00.855070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6d05ec6c-db10-4295-8a2b-1e64a7888d0c None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:00.856954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6d05ec6c-db10-4295-8a2b-1e64a7888d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:00.971213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 714/1413] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Aug 31 01:02:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:03.361486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a0f8-2c9b-4bed-9763-5bc365ce90fb None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:03.362019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a0f8-2c9b-4bed-9763-5bc365ce90fb None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:03.362019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a0f8-2c9b-4bed-9763-5bc365ce90fb None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:03.363385 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:03.368757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d706-8232-40bc-924c-762738c7f882 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:03.369210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d706-8232-40bc-924c-762738c7f882 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:03.369308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d706-8232-40bc-924c-762738c7f882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:03.433796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8030d706-8232-40bc-924c-762738c7f882 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:03.434900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8030d706-8232-40bc-924c-762738c7f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:03.491465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:03.534103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:03.820945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6a0f8-2c9b-4bed-9763-5bc365ce90fb None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:03.822532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1ec6a0f8-2c9b-4bed-9763-5bc365ce90fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:03.965656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6a0f8-2c9b-4bed-9763-5bc365ce90fb None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:04.037750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:04.078319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b47602-27df-4d17-80e3-a81fcae010c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:04.078874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b47602-27df-4d17-80e3-a81fcae010c3 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:04.079246 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b47602-27df-4d17-80e3-a81fcae010c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:04.079555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b47602-27df-4d17-80e3-a81fcae010c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:04.081193 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b3b47602-27df-4d17-80e3-a81fcae010c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:04.170473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b47602-27df-4d17-80e3-a81fcae010c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:04.172070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b47602-27df-4d17-80e3-a81fcae010c3 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:04.191083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 701/1416] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:05.088269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff25f55-7b68-4045-a6e0-4291edda20cd None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:05.088873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff25f55-7b68-4045-a6e0-4291edda20cd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:05.088972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff25f55-7b68-4045-a6e0-4291edda20cd None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:05.090275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:05.095103 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2734-f028-4cfd-971e-399d8be8fc35 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:05.095496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2734-f028-4cfd-971e-399d8be8fc35 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:05.095657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2734-f028-4cfd-971e-399d8be8fc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:05.171383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-078e2734-f028-4cfd-971e-399d8be8fc35 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:05.173245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-078e2734-f028-4cfd-971e-399d8be8fc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:05.199773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:05.269498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:05.419053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff25f55-7b68-4045-a6e0-4291edda20cd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:05.420599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4ff25f55-7b68-4045-a6e0-4291edda20cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:05.562608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff25f55-7b68-4045-a6e0-4291edda20cd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:05.602472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:05.673643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525353f6-41e0-486c-88c3-2964f460dcc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:05.674163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525353f6-41e0-486c-88c3-2964f460dcc8 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:05.674449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525353f6-41e0-486c-88c3-2964f460dcc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:05.674719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525353f6-41e0-486c-88c3-2964f460dcc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:05.676293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-525353f6-41e0-486c-88c3-2964f460dcc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:05.766028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525353f6-41e0-486c-88c3-2964f460dcc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:05.767757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525353f6-41e0-486c-88c3-2964f460dcc8 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:05.786066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 717/1419] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:06.670386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30084d-8d38-47ce-a97f-dc290c966c76 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:06.670963 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30084d-8d38-47ce-a97f-dc290c966c76 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:06.670963 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30084d-8d38-47ce-a97f-dc290c966c76 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:06.672379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:06.677255 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82320b75-ebab-45b7-a0c7-f3f8576d1771 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:06.677709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82320b75-ebab-45b7-a0c7-f3f8576d1771 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:06.677813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82320b75-ebab-45b7-a0c7-f3f8576d1771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:06.731865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:06.753909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-82320b75-ebab-45b7-a0c7-f3f8576d1771 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:06.755150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-82320b75-ebab-45b7-a0c7-f3f8576d1771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:06.857065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:07.009306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30084d-8d38-47ce-a97f-dc290c966c76 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:07.010902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5a30084d-8d38-47ce-a97f-dc290c966c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:07.156905 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30084d-8d38-47ce-a97f-dc290c966c76 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:07.169072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:07.271655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4baa9a-d301-4820-9b55-03e9b3201439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:07.272169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4baa9a-d301-4820-9b55-03e9b3201439 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:07.272488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4baa9a-d301-4820-9b55-03e9b3201439 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:07.272762 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4baa9a-d301-4820-9b55-03e9b3201439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:07.274347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8b4baa9a-d301-4820-9b55-03e9b3201439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:07.361726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4baa9a-d301-4820-9b55-03e9b3201439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:07.363319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4baa9a-d301-4820-9b55-03e9b3201439 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:07.381678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 704/1422] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:08.261907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e3fb-aa2c-4fba-b5fb-f9f11016d7d1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:08.262456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e3fb-aa2c-4fba-b5fb-f9f11016d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:08.262456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e3fb-aa2c-4fba-b5fb-f9f11016d7d1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:08.263799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:08.269403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a9ce9-75c4-4c13-ac71-665972f5333e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:08.269838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a9ce9-75c4-4c13-ac71-665972f5333e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:08.269947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a9ce9-75c4-4c13-ac71-665972f5333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:08.291857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:08.349203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-405a9ce9-75c4-4c13-ac71-665972f5333e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:08.350416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-405a9ce9-75c4-4c13-ac71-665972f5333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:08.445716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:08.598193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8e3fb-aa2c-4fba-b5fb-f9f11016d7d1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:08.599642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fab8e3fb-aa2c-4fba-b5fb-f9f11016d7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:08.707500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:08.745050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8e3fb-aa2c-4fba-b5fb-f9f11016d7d1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:08.857177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca7ef8-5f0c-447d-8611-34768d2a9132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:08.857706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7ef8-5f0c-447d-8611-34768d2a9132 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:08.857989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7ef8-5f0c-447d-8611-34768d2a9132 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:08.858267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7ef8-5f0c-447d-8611-34768d2a9132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:08.860455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e2ca7ef8-5f0c-447d-8611-34768d2a9132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:08.936387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:08.950486 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca7ef8-5f0c-447d-8611-34768d2a9132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:08.952098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca7ef8-5f0c-447d-8611-34768d2a9132 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:08.970609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 720/1425] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:09.834077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45d67-80c7-452c-b9d9-e8b893684375 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:09.834613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45d67-80c7-452c-b9d9-e8b893684375 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:09.834735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45d67-80c7-452c-b9d9-e8b893684375 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:09.835995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:09.841102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec887cf9-c702-4c5a-979e-54b9ec5d353b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:09.841514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec887cf9-c702-4c5a-979e-54b9ec5d353b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:09.841654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec887cf9-c702-4c5a-979e-54b9ec5d353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:09.922770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ec887cf9-c702-4c5a-979e-54b9ec5d353b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:09.923978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ec887cf9-c702-4c5a-979e-54b9ec5d353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:10.020015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:10.171252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45d67-80c7-452c-b9d9-e8b893684375 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:10.173478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c5f45d67-80c7-452c-b9d9-e8b893684375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:10.256778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:10.320523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45d67-80c7-452c-b9d9-e8b893684375 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:10.432923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ab4d5-6a2c-4de0-be7f-16e80bbb7f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:10.433529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ab4d5-6a2c-4de0-be7f-16e80bbb7f21 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:10.433808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ab4d5-6a2c-4de0-be7f-16e80bbb7f21 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:10.434085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ab4d5-6a2c-4de0-be7f-16e80bbb7f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:10.435668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2e7ab4d5-6a2c-4de0-be7f-16e80bbb7f21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:10.483914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:10.526433 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ab4d5-6a2c-4de0-be7f-16e80bbb7f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:10.528016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ab4d5-6a2c-4de0-be7f-16e80bbb7f21 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:10.545863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 707/1428] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:11.351389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a523-4292-4fb3-a005-fbcd98aafc80 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:11.351953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a523-4292-4fb3-a005-fbcd98aafc80 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:11.351953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a523-4292-4fb3-a005-fbcd98aafc80 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:11.353290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:11.358155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1db7b8-e5eb-47b1-91c4-9c64b6c79bce None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:11.358563 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1db7b8-e5eb-47b1-91c4-9c64b6c79bce None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:11.358711 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1db7b8-e5eb-47b1-91c4-9c64b6c79bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:11.433522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-aa1db7b8-e5eb-47b1-91c4-9c64b6c79bce None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:11.434737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aa1db7b8-e5eb-47b1-91c4-9c64b6c79bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:11.528832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:11.681680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a523-4292-4fb3-a005-fbcd98aafc80 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:11.683232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3350a523-4292-4fb3-a005-fbcd98aafc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:11.732352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:11.829671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a523-4292-4fb3-a005-fbcd98aafc80 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:11.941978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be132263-86d3-41a8-98df-63c4e38b63df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:11.942498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be132263-86d3-41a8-98df-63c4e38b63df service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:11.942778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be132263-86d3-41a8-98df-63c4e38b63df service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:11.943048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be132263-86d3-41a8-98df-63c4e38b63df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:11.944659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-be132263-86d3-41a8-98df-63c4e38b63df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:11.951381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:12.035186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be132263-86d3-41a8-98df-63c4e38b63df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:12.036858 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be132263-86d3-41a8-98df-63c4e38b63df service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:12.060246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 723/1431] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:12.878517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2b98-d06b-4872-9dc6-0a4a407c806d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:12.879041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2b98-d06b-4872-9dc6-0a4a407c806d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:12.879136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2b98-d06b-4872-9dc6-0a4a407c806d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:12.880470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:12.885613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d797f-832e-420e-b46c-fb923b2b46ba None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:12.886012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d797f-832e-420e-b46c-fb923b2b46ba None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:12.886175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d797f-832e-420e-b46c-fb923b2b46ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:12.971075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ea4d797f-832e-420e-b46c-fb923b2b46ba None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:12.972302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ea4d797f-832e-420e-b46c-fb923b2b46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:13.039062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:13.068126 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:13.219711 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2b98-d06b-4872-9dc6-0a4a407c806d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:13.221256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5e9f2b98-d06b-4872-9dc6-0a4a407c806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:13.239220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:13.367825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2b98-d06b-4872-9dc6-0a4a407c806d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:13.458595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:13.485407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5704c-9864-4662-8aa9-a9b156fc1f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:13.486013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5704c-9864-4662-8aa9-a9b156fc1f20 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:13.486295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5704c-9864-4662-8aa9-a9b156fc1f20 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:13.486570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5704c-9864-4662-8aa9-a9b156fc1f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:13.488177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b4a5704c-9864-4662-8aa9-a9b156fc1f20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:13.579300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5704c-9864-4662-8aa9-a9b156fc1f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:13.580958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5704c-9864-4662-8aa9-a9b156fc1f20 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:13.599029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 710/1434] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:14.398083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69d68f-253e-43df-8db4-bf3b0bc31f22 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:14.398632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69d68f-253e-43df-8db4-bf3b0bc31f22 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:14.398750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69d68f-253e-43df-8db4-bf3b0bc31f22 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:14.400014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:14.404940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cfa7e-1e4a-479a-bf00-ec88d972d970 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:14.405347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cfa7e-1e4a-479a-bf00-ec88d972d970 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:14.405488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cfa7e-1e4a-479a-bf00-ec88d972d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:14.483268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-774cfa7e-1e4a-479a-bf00-ec88d972d970 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:14.484517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-774cfa7e-1e4a-479a-bf00-ec88d972d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:14.525668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:14.588195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:14.737424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69d68f-253e-43df-8db4-bf3b0bc31f22 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:14.738864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3d69d68f-253e-43df-8db4-bf3b0bc31f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:14.882311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69d68f-253e-43df-8db4-bf3b0bc31f22 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:14.941617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:15.001874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a67208-6280-42dd-8a85-65c495774b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:15.002405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67208-6280-42dd-8a85-65c495774b9a service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:15.002687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67208-6280-42dd-8a85-65c495774b9a service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:15.002963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67208-6280-42dd-8a85-65c495774b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:15.004583 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b8a67208-6280-42dd-8a85-65c495774b9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:15.092674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a67208-6280-42dd-8a85-65c495774b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:15.094868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a67208-6280-42dd-8a85-65c495774b9a service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:15.112723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 726/1437] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:15.925939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44586e5f-2d49-4e09-a190-20e3fb4d4046 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:15.926513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44586e5f-2d49-4e09-a190-20e3fb4d4046 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:15.926513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44586e5f-2d49-4e09-a190-20e3fb4d4046 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:15.927900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:15.932730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bd539-5a6f-416d-9f5c-a2f2fb0d8dc3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:15.933159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bd539-5a6f-416d-9f5c-a2f2fb0d8dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:15.933286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bd539-5a6f-416d-9f5c-a2f2fb0d8dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:16.010289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-228bd539-5a6f-416d-9f5c-a2f2fb0d8dc3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:16.011481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-228bd539-5a6f-416d-9f5c-a2f2fb0d8dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:16.013493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:16.108872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:16.261583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44586e5f-2d49-4e09-a190-20e3fb4d4046 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:16.263024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-44586e5f-2d49-4e09-a190-20e3fb4d4046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:16.416956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44586e5f-2d49-4e09-a190-20e3fb4d4046 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:16.444602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:16.530295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69e3b8-5ad5-4bda-99b1-c7761373c3fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:16.530814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69e3b8-5ad5-4bda-99b1-c7761373c3fe service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:16.531092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69e3b8-5ad5-4bda-99b1-c7761373c3fe service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:16.531431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69e3b8-5ad5-4bda-99b1-c7761373c3fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:16.533077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3c69e3b8-5ad5-4bda-99b1-c7761373c3fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:16.620294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69e3b8-5ad5-4bda-99b1-c7761373c3fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:16.621904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69e3b8-5ad5-4bda-99b1-c7761373c3fe service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:16.640605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 713/1440] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:18.462450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45bdb-be6b-4b5f-8f05-f85d091373d0 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:18.463018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45bdb-be6b-4b5f-8f05-f85d091373d0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:18.463018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45bdb-be6b-4b5f-8f05-f85d091373d0 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:18.464380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:18.469665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d317-3a98-4c8c-991d-aca1be6b93f2 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:18.470101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d317-3a98-4c8c-991d-aca1be6b93f2 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:18.470224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d317-3a98-4c8c-991d-aca1be6b93f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:18.510731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:18.536795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-15a2d317-3a98-4c8c-991d-aca1be6b93f2 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:18.538005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-15a2d317-3a98-4c8c-991d-aca1be6b93f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:18.640310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:18.926910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45bdb-be6b-4b5f-8f05-f85d091373d0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:18.928508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c1f45bdb-be6b-4b5f-8f05-f85d091373d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:19.030934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45bdb-be6b-4b5f-8f05-f85d091373d0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:19.062437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:19.103844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65395d-b12e-4e77-bd64-cd7085a94980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:19.104476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65395d-b12e-4e77-bd64-cd7085a94980 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:19.104761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65395d-b12e-4e77-bd64-cd7085a94980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:19.105036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65395d-b12e-4e77-bd64-cd7085a94980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:19.106629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4c65395d-b12e-4e77-bd64-cd7085a94980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:19.216357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65395d-b12e-4e77-bd64-cd7085a94980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:19.217726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65395d-b12e-4e77-bd64-cd7085a94980 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:19.236665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 729/1443] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:21.361559 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d7e8b-b66d-4898-bcdb-fa7f85c9df87 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:21.362160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d7e8b-b66d-4898-bcdb-fa7f85c9df87 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:21.362160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d7e8b-b66d-4898-bcdb-fa7f85c9df87 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:21.363443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:21.368754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190915c-8956-4fee-a365-7b4634e46b36 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:21.369194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190915c-8956-4fee-a365-7b4634e46b36 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:21.369302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190915c-8956-4fee-a365-7b4634e46b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:21.435003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3190915c-8956-4fee-a365-7b4634e46b36 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:21.436117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3190915c-8956-4fee-a365-7b4634e46b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:21.449267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:21.534133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:21.821140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d7e8b-b66d-4898-bcdb-fa7f85c9df87 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:21.822719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-094d7e8b-b66d-4898-bcdb-fa7f85c9df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:21.927284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d7e8b-b66d-4898-bcdb-fa7f85c9df87 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:21.939193 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:22.000556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820e7a5-8036-4cf4-94aa-31c15457bd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:22.001163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e7a5-8036-4cf4-94aa-31c15457bd59 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:22.001448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e7a5-8036-4cf4-94aa-31c15457bd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:22.001723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e7a5-8036-4cf4-94aa-31c15457bd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:22.003313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0820e7a5-8036-4cf4-94aa-31c15457bd59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:22.112934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820e7a5-8036-4cf4-94aa-31c15457bd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:22.114288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820e7a5-8036-4cf4-94aa-31c15457bd59 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:22.134248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 716/1446] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:24.351546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a34a7-8220-4f9d-94d3-438b7fe5af4d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:24.352071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a34a7-8220-4f9d-94d3-438b7fe5af4d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:24.352071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a34a7-8220-4f9d-94d3-438b7fe5af4d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:24.353532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:24.358585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564fdbe-6ecf-42d0-98a8-ae1a1b5cce86 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:24.358989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564fdbe-6ecf-42d0-98a8-ae1a1b5cce86 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:24.359111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564fdbe-6ecf-42d0-98a8-ae1a1b5cce86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:24.410429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:24.428891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a564fdbe-6ecf-42d0-98a8-ae1a1b5cce86 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:24.430101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a564fdbe-6ecf-42d0-98a8-ae1a1b5cce86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:24.528896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:24.820185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a34a7-8220-4f9d-94d3-438b7fe5af4d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:24.821775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-032a34a7-8220-4f9d-94d3-438b7fe5af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:24.925420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a34a7-8220-4f9d-94d3-438b7fe5af4d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:24.964776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:24.998703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde458-696e-4746-9159-5c14458dca0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:24.999309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde458-696e-4746-9159-5c14458dca0d service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:24.999592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde458-696e-4746-9159-5c14458dca0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:24.999987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde458-696e-4746-9159-5c14458dca0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:25.002150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d0bde458-696e-4746-9159-5c14458dca0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:25.109835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bde458-696e-4746-9159-5c14458dca0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:25.111458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bde458-696e-4746-9159-5c14458dca0d service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:25.129824 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 732/1449] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:27.168986 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35777d28-60f8-40e5-b3be-4a2ac5e4bde5 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:27.169460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35777d28-60f8-40e5-b3be-4a2ac5e4bde5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:27.169638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35777d28-60f8-40e5-b3be-4a2ac5e4bde5 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:27.171003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:27.176781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf81a4-0aee-436d-8fd8-60fcb5342e12 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:27.177245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf81a4-0aee-436d-8fd8-60fcb5342e12 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:27.177372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf81a4-0aee-436d-8fd8-60fcb5342e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:27.242218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4faf81a4-0aee-436d-8fd8-60fcb5342e12 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:27.243410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4faf81a4-0aee-436d-8fd8-60fcb5342e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:27.264016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:27.339073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:27.621587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35777d28-60f8-40e5-b3be-4a2ac5e4bde5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:27.623204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-35777d28-60f8-40e5-b3be-4a2ac5e4bde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:27.726527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35777d28-60f8-40e5-b3be-4a2ac5e4bde5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:27.746343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:27.800003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c114ceb-5d16-4c7d-907e-d1441e3f26f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:27.800653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c114ceb-5d16-4c7d-907e-d1441e3f26f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:27.800964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c114ceb-5d16-4c7d-907e-d1441e3f26f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:27.801238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c114ceb-5d16-4c7d-907e-d1441e3f26f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:27.802882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6c114ceb-5d16-4c7d-907e-d1441e3f26f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:27.911824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c114ceb-5d16-4c7d-907e-d1441e3f26f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:27.913283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c114ceb-5d16-4c7d-907e-d1441e3f26f3 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:27.932642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 719/1452] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:29.908449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddac08-8061-49a2-96d4-8f263b6ac9ab None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:29.909057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddac08-8061-49a2-96d4-8f263b6ac9ab None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:29.909057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddac08-8061-49a2-96d4-8f263b6ac9ab None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:29.910378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:29.915584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe420-2134-49f3-8115-b41f23adf17c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:29.916011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe420-2134-49f3-8115-b41f23adf17c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:29.916145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe420-2134-49f3-8115-b41f23adf17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:29.985278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:29.988501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-69dfe420-2134-49f3-8115-b41f23adf17c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:29.990137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-69dfe420-2134-49f3-8115-b41f23adf17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:30.085320 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:30.382616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddac08-8061-49a2-96d4-8f263b6ac9ab None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:30.384176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7cddac08-8061-49a2-96d4-8f263b6ac9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:30.496284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddac08-8061-49a2-96d4-8f263b6ac9ab None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:30.545357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:30.571448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b6104-77fa-45e4-bcc6-b81f8e863ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:30.572058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b6104-77fa-45e4-bcc6-b81f8e863ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:30.572476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b6104-77fa-45e4-bcc6-b81f8e863ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:30.572759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b6104-77fa-45e4-bcc6-b81f8e863ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:30.574360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-447b6104-77fa-45e4-bcc6-b81f8e863ea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:30.687175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b6104-77fa-45e4-bcc6-b81f8e863ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:30.688727 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b6104-77fa-45e4-bcc6-b81f8e863ea0 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:30.706472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 735/1455] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:32.679718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683dc6b-a7e7-43c8-9cf0-4a0825382e4b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:32.680289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683dc6b-a7e7-43c8-9cf0-4a0825382e4b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:32.680289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683dc6b-a7e7-43c8-9cf0-4a0825382e4b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:32.681633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:32.686897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ec0f-c541-4b88-83bd-53d1218d5cd9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:32.687833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ec0f-c541-4b88-83bd-53d1218d5cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:32.687960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ec0f-c541-4b88-83bd-53d1218d5cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:32.756616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-de81ec0f-c541-4b88-83bd-53d1218d5cd9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:32.757830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-de81ec0f-c541-4b88-83bd-53d1218d5cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:32.786865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:32.855437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:33.151265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683dc6b-a7e7-43c8-9cf0-4a0825382e4b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:33.152955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8683dc6b-a7e7-43c8-9cf0-4a0825382e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:33.256971 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683dc6b-a7e7-43c8-9cf0-4a0825382e4b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:33.284290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:33.329637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd522f7-47b8-41d9-b1eb-9900f3395e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:33.330254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd522f7-47b8-41d9-b1eb-9900f3395e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:33.330539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd522f7-47b8-41d9-b1eb-9900f3395e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:33.330815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd522f7-47b8-41d9-b1eb-9900f3395e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:33.332468 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4cd522f7-47b8-41d9-b1eb-9900f3395e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:33.442254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd522f7-47b8-41d9-b1eb-9900f3395e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:33.443700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd522f7-47b8-41d9-b1eb-9900f3395e0a service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:33.462469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 722/1458] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:35.426153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a62b2-bd44-4db0-b26a-306368cba96c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:35.426678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a62b2-bd44-4db0-b26a-306368cba96c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:35.426678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a62b2-bd44-4db0-b26a-306368cba96c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:35.427995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:35.433216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a8bbd-2134-47d7-8d3b-e43f6d943c4f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:35.433647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a8bbd-2134-47d7-8d3b-e43f6d943c4f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:35.433770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a8bbd-2134-47d7-8d3b-e43f6d943c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:35.499454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b97a8bbd-2134-47d7-8d3b-e43f6d943c4f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:35.501429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b97a8bbd-2134-47d7-8d3b-e43f6d943c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:35.509784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:35.597699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:35.882855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a62b2-bd44-4db0-b26a-306368cba96c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:35.884435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bc7a62b2-bd44-4db0-b26a-306368cba96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:35.987711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a62b2-bd44-4db0-b26a-306368cba96c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:36.045949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:36.063556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1da5ca-b3f8-48d1-b1f9-0f365d738d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:36.064163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1da5ca-b3f8-48d1-b1f9-0f365d738d6c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:36.064476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1da5ca-b3f8-48d1-b1f9-0f365d738d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:36.064750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1da5ca-b3f8-48d1-b1f9-0f365d738d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:36.066345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d1da5ca-b3f8-48d1-b1f9-0f365d738d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:36.175069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1da5ca-b3f8-48d1-b1f9-0f365d738d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:36.176530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1da5ca-b3f8-48d1-b1f9-0f365d738d6c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:36.194200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 738/1461] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:38.148749 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da2f1-aa26-40cf-b98e-8a3490678d2a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:38.149272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da2f1-aa26-40cf-b98e-8a3490678d2a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:38.149364 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da2f1-aa26-40cf-b98e-8a3490678d2a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:38.150685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:38.155937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d542db-7d0c-4bd2-b316-b5404da5454a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:38.156437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d542db-7d0c-4bd2-b316-b5404da5454a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:38.156546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d542db-7d0c-4bd2-b316-b5404da5454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:38.221655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-61d542db-7d0c-4bd2-b316-b5404da5454a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:38.222871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-61d542db-7d0c-4bd2-b316-b5404da5454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:38.260776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:38.320470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:38.605521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308da2f1-aa26-40cf-b98e-8a3490678d2a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:38.607071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-308da2f1-aa26-40cf-b98e-8a3490678d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:38.710570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308da2f1-aa26-40cf-b98e-8a3490678d2a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:38.750093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:38.786419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d42a74-d9d3-48b0-94db-18e1fd640ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:38.787030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d42a74-d9d3-48b0-94db-18e1fd640ebc service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:38.787310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d42a74-d9d3-48b0-94db-18e1fd640ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:38.787601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d42a74-d9d3-48b0-94db-18e1fd640ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:38.789207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c9d42a74-d9d3-48b0-94db-18e1fd640ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:38.895759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d42a74-d9d3-48b0-94db-18e1fd640ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:38.897209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d42a74-d9d3-48b0-94db-18e1fd640ebc service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:38.916897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 725/1464] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:40.821876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d275b-1507-46cc-97a1-71eb7883721d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:40.822320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d275b-1507-46cc-97a1-71eb7883721d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:40.822456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d275b-1507-46cc-97a1-71eb7883721d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:40.823812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:40.829491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df21dd-e65b-47a8-9c0c-101304eb56f7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:40.829959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df21dd-e65b-47a8-9c0c-101304eb56f7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:40.830074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df21dd-e65b-47a8-9c0c-101304eb56f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:40.895603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-35df21dd-e65b-47a8-9c0c-101304eb56f7 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:40.896928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-35df21dd-e65b-47a8-9c0c-101304eb56f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:40.915282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:40.995244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:41.275392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d275b-1507-46cc-97a1-71eb7883721d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:41.276982 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-308d275b-1507-46cc-97a1-71eb7883721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:41.383591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d275b-1507-46cc-97a1-71eb7883721d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:41.448631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:41.455757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8066027-0312-4538-a236-2b6f7b4f12f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:41.456392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066027-0312-4538-a236-2b6f7b4f12f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:41.456684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066027-0312-4538-a236-2b6f7b4f12f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:41.456959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066027-0312-4538-a236-2b6f7b4f12f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:41.458544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a8066027-0312-4538-a236-2b6f7b4f12f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:41.567074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8066027-0312-4538-a236-2b6f7b4f12f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:41.568538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8066027-0312-4538-a236-2b6f7b4f12f8 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:41.586348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 741/1467] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:02:43.506571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc6277-7253-49cd-abe5-d3bf82fc5f10 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:43.507164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc6277-7253-49cd-abe5-d3bf82fc5f10 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:43.507164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc6277-7253-49cd-abe5-d3bf82fc5f10 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:43.508410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:02:43.513692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55f0c-3788-4729-92cd-0321f9361201 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:43.514075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55f0c-3788-4729-92cd-0321f9361201 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:43.514241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55f0c-3788-4729-92cd-0321f9361201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:43.582172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2ef55f0c-3788-4729-92cd-0321f9361201 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:02:43.583393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2ef55f0c-3788-4729-92cd-0321f9361201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:43.633185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:43.681601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:02:43.972464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc6277-7253-49cd-abe5-d3bf82fc5f10 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:02:43.974023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cbbc6277-7253-49cd-abe5-d3bf82fc5f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:44.078414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc6277-7253-49cd-abe5-d3bf82fc5f10 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:02:44.126730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:44.153542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1aaf-4217-48d9-b73c-c28fed216622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:02:44.154149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1aaf-4217-48d9-b73c-c28fed216622 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:02:44.154429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1aaf-4217-48d9-b73c-c28fed216622 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:02:44.154702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1aaf-4217-48d9-b73c-c28fed216622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:02:44.157008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-720b1aaf-4217-48d9-b73c-c28fed216622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:02:44.264541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b1aaf-4217-48d9-b73c-c28fed216622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:02:44.265978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b1aaf-4217-48d9-b73c-c28fed216622 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:02:44.284697 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 728/1470] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:02:53.679794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=22 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:54.282340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=66 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:03.989298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9c649-67ef-4151-b8f1-ca7cb4617600 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:03.989914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9c649-67ef-4151-b8f1-ca7cb4617600 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:03.989914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9c649-67ef-4151-b8f1-ca7cb4617600 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:03.991200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 743/1471] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:03:03.996481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd02ac-9142-42c5-bb3d-d720591603d5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:03.996880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd02ac-9142-42c5-bb3d-d720591603d5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:03.997051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd02ac-9142-42c5-bb3d-d720591603d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:04.072005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2ffd02ac-9142-42c5-bb3d-d720591603d5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:03:04.073265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2ffd02ac-9142-42c5-bb3d-d720591603d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:04.170071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 729/1472] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:03:04.475398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91497a47-9a8c-463e-88d5-19f12eb1230c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:04.475688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91497a47-9a8c-463e-88d5-19f12eb1230c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:04.475962 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91497a47-9a8c-463e-88d5-19f12eb1230c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:04.477354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 744/1473] 10.222.0.83 () {54 vars in 967 bytes} [Wed Aug 31 01:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:03:04.482281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd136-67d5-4066-bdab-54fbc1337130 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:04.482604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd136-67d5-4066-bdab-54fbc1337130 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:04.482887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd136-67d5-4066-bdab-54fbc1337130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:04.560196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c1ccd136-67d5-4066-bdab-54fbc1337130 None None] MFA Rules not processed for user `deb70dd34dc642cfbb49b4e1a0434399`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:03:04.561457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c1ccd136-67d5-4066-bdab-54fbc1337130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:04.582998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:04.641077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 730/1474] 10.222.0.83 () {58 vars in 1064 bytes} [Wed Aug 31 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:03:04.648496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91497a47-9a8c-463e-88d5-19f12eb1230c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:03:04.650054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-91497a47-9a8c-463e-88d5-19f12eb1230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:04.755709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91497a47-9a8c-463e-88d5-19f12eb1230c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:03:04.828986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51988abf-79a0-481c-a678-a9b9a5f5175b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb70dd34dc642cfbb49b4e1a0434399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:03:04.829594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988abf-79a0-481c-a678-a9b9a5f5175b service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:04.829879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988abf-79a0-481c-a678-a9b9a5f5175b service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:04.830153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988abf-79a0-481c-a678-a9b9a5f5175b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:04.831754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-51988abf-79a0-481c-a678-a9b9a5f5175b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:04.888143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:04.944549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51988abf-79a0-481c-a678-a9b9a5f5175b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:03:04.945991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51988abf-79a0-481c-a678-a9b9a5f5175b service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:03:04.964240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 745/1475] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:03:06.999463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54285-d9f1-4866-bb44-3c8f671c27fd None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:07.000129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54285-d9f1-4866-bb44-3c8f671c27fd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:07.000425 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54285-d9f1-4866-bb44-3c8f671c27fd None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:07.001938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 731/1476] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:03:07.007315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80231f24-2783-44f8-b8c4-24b68b63118b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:07.007767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80231f24-2783-44f8-b8c4-24b68b63118b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:07.007878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80231f24-2783-44f8-b8c4-24b68b63118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:07.073652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-80231f24-2783-44f8-b8c4-24b68b63118b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:03:07.074840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-80231f24-2783-44f8-b8c4-24b68b63118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:07.176265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 746/1477] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:03:07.449596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54285-d9f1-4866-bb44-3c8f671c27fd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:03:07.451113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dad54285-d9f1-4866-bb44-3c8f671c27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:07.575640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54285-d9f1-4866-bb44-3c8f671c27fd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:03:07.624202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:07.673042 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7a9b9-8aed-4bfb-9585-27dddb397afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:03:07.673651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a9b9-8aed-4bfb-9585-27dddb397afa admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:07.673927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a9b9-8aed-4bfb-9585-27dddb397afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:07.674192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a9b9-8aed-4bfb-9585-27dddb397afa admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:07.674829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7a9b9-8aed-4bfb-9585-27dddb397afa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:03:07.676548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WARNING py.warnings [None req-e9c7a9b9-8aed-4bfb-9585-27dddb397afa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:03:07.676548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 01:03:07.676548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: Aug 31 01:03:07.677689 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7a9b9-8aed-4bfb-9585-27dddb397afa admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:03:07.697380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 732/1478] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Aug 31 01:03:07 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:03:09.647226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe460-b309-4506-ae98-2e574724e044 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:09.647770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe460-b309-4506-ae98-2e574724e044 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:09.647770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe460-b309-4506-ae98-2e574724e044 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:09.649146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 747/1479] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:03:09.654259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf3603-a429-43d2-99f7-87158ff937a1 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:09.654702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf3603-a429-43d2-99f7-87158ff937a1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:09.654854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf3603-a429-43d2-99f7-87158ff937a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:09.722596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b7cf3603-a429-43d2-99f7-87158ff937a1 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:03:09.723803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b7cf3603-a429-43d2-99f7-87158ff937a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:09.820607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 733/1480] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:03:10.118596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debe460-b309-4506-ae98-2e574724e044 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:03:10.120245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5debe460-b309-4506-ae98-2e574724e044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:10.130205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:10.264707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debe460-b309-4506-ae98-2e574724e044 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:03:10.344767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:10.377859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d509ff-2b34-42b2-a48e-4b7db0f56f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:03:10.378464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d509ff-2b34-42b2-a48e-4b7db0f56f18 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:10.378744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d509ff-2b34-42b2-a48e-4b7db0f56f18 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:10.379019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d509ff-2b34-42b2-a48e-4b7db0f56f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:10.380770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-17d509ff-2b34-42b2-a48e-4b7db0f56f18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:10.468765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d509ff-2b34-42b2-a48e-4b7db0f56f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:03:10.470680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d509ff-2b34-42b2-a48e-4b7db0f56f18 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:03:10.488214 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 748/1481] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:03:12.584592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26c6a7-35a5-41f0-9dd1-dfd13b7cfd8a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:12.585180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26c6a7-35a5-41f0-9dd1-dfd13b7cfd8a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:12.585180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26c6a7-35a5-41f0-9dd1-dfd13b7cfd8a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:12.586769 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 734/1482] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:03:12.592004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce0713-d11a-4460-8165-9b3d16581f29 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:12.592466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce0713-d11a-4460-8165-9b3d16581f29 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:12.592574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce0713-d11a-4460-8165-9b3d16581f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:12.660936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-26ce0713-d11a-4460-8165-9b3d16581f29 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:03:12.662137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-26ce0713-d11a-4460-8165-9b3d16581f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:12.825711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:12.876436 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 749/1483] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:03:13.164743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26c6a7-35a5-41f0-9dd1-dfd13b7cfd8a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:03:13.166277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ed26c6a7-35a5-41f0-9dd1-dfd13b7cfd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:13.192118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:13.271601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26c6a7-35a5-41f0-9dd1-dfd13b7cfd8a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:03:13.344773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399d8da-fec5-4676-9d29-02d7b2e25bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:03:13.345433 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d8da-fec5-4676-9d29-02d7b2e25bce service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:13.345722 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d8da-fec5-4676-9d29-02d7b2e25bce service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:13.346002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d8da-fec5-4676-9d29-02d7b2e25bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:13.347618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b399d8da-fec5-4676-9d29-02d7b2e25bce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:13.423292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:13.460801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399d8da-fec5-4676-9d29-02d7b2e25bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:03:13.462488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399d8da-fec5-4676-9d29-02d7b2e25bce service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:03:13.481943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 735/1484] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:03:15.446127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddd8e4-7f80-4bca-8323-f5b4491a07a6 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:15.446669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddd8e4-7f80-4bca-8323-f5b4491a07a6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:15.446669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddd8e4-7f80-4bca-8323-f5b4491a07a6 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:15.448074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 750/1485] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:03:15.454125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208387a-4376-4877-b581-b145059a2cf7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:15.454574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208387a-4376-4877-b581-b145059a2cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:15.454679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208387a-4376-4877-b581-b145059a2cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:15.519815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0208387a-4376-4877-b581-b145059a2cf7 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:03:15.521054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0208387a-4376-4877-b581-b145059a2cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:15.616128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 736/1486] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:03:15.903700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddd8e4-7f80-4bca-8323-f5b4491a07a6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:03:15.905246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c7ddd8e4-7f80-4bca-8323-f5b4491a07a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:16.005591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddd8e4-7f80-4bca-8323-f5b4491a07a6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:03:16.076148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:16.078190 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f45493-c5d7-45af-991d-649fefa776b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:03:16.078807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f45493-c5d7-45af-991d-649fefa776b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:16.079272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f45493-c5d7-45af-991d-649fefa776b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:16.079589 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f45493-c5d7-45af-991d-649fefa776b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:16.081598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b2f45493-c5d7-45af-991d-649fefa776b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:16.200041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f45493-c5d7-45af-991d-649fefa776b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:03:16.201545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f45493-c5d7-45af-991d-649fefa776b5 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:03:16.220400 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 751/1487] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:03:18.237945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688d65-1ce4-474d-90f1-7b7d47dd8556 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:18.238529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688d65-1ce4-474d-90f1-7b7d47dd8556 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:18.238529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688d65-1ce4-474d-90f1-7b7d47dd8556 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:18.241342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 737/1488] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:03:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:03:18.246820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27f26b-4769-4a17-b7d9-82bd9fc48f5c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:18.247289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27f26b-4769-4a17-b7d9-82bd9fc48f5c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:18.247446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27f26b-4769-4a17-b7d9-82bd9fc48f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:18.312397 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1c27f26b-4769-4a17-b7d9-82bd9fc48f5c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:03:18.313757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1c27f26b-4769-4a17-b7d9-82bd9fc48f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:18.366570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:18.412638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 752/1489] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:03:18.704704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d688d65-1ce4-474d-90f1-7b7d47dd8556 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:03:18.706276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0d688d65-1ce4-474d-90f1-7b7d47dd8556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:18.743257 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:18.810597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d688d65-1ce4-474d-90f1-7b7d47dd8556 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:03:18.888030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5899506-e8c1-4053-a582-a21302a60ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:03:18.888671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899506-e8c1-4053-a582-a21302a60ebf service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:18.888958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899506-e8c1-4053-a582-a21302a60ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:18.889233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899506-e8c1-4053-a582-a21302a60ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:18.890868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e5899506-e8c1-4053-a582-a21302a60ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:18.970842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:19.000682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5899506-e8c1-4053-a582-a21302a60ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:03:19.002125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5899506-e8c1-4053-a582-a21302a60ebf service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:03:19.020184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 738/1490] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:03:21.104758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdaa46-8d8a-402d-986f-736d41d6ab5e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:21.105331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdaa46-8d8a-402d-986f-736d41d6ab5e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:21.105331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdaa46-8d8a-402d-986f-736d41d6ab5e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:21.106631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 753/1491] 10.222.0.83 () {54 vars in 927 bytes} [Wed Aug 31 01:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:03:21.111882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838fed-2c12-46d2-8279-018c82522a10 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:21.112312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838fed-2c12-46d2-8279-018c82522a10 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:21.112459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838fed-2c12-46d2-8279-018c82522a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:21.180979 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-48838fed-2c12-46d2-8279-018c82522a10 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:03:21.182195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-48838fed-2c12-46d2-8279-018c82522a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:21.277477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 739/1492] 10.222.0.83 () {58 vars in 1024 bytes} [Wed Aug 31 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:03:21.566060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdaa46-8d8a-402d-986f-736d41d6ab5e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:03:21.567628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e7cdaa46-8d8a-402d-986f-736d41d6ab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:21.684474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdaa46-8d8a-402d-986f-736d41d6ab5e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:03:21.758204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d6ae5-c6a3-4d57-aa4c-a608199ee197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:03:21.758788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6ae5-c6a3-4d57-aa4c-a608199ee197 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:03:21.759066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6ae5-c6a3-4d57-aa4c-a608199ee197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:03:21.759336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6ae5-c6a3-4d57-aa4c-a608199ee197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:03:21.760937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b53d6ae5-c6a3-4d57-aa4c-a608199ee197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:03:21.770581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:21.868662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d6ae5-c6a3-4d57-aa4c-a608199ee197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:03:21.870005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d6ae5-c6a3-4d57-aa4c-a608199ee197 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:03:21.888028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 754/1493] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:03:31.275639 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=82 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:31.885816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=50 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:41.029256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fdb62-9dd4-4644-805f-e75f20f61ff9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:41.031483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fdb62-9dd4-4644-805f-e75f20f61ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:41.031483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fdb62-9dd4-4644-805f-e75f20f61ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:41.108782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b10fdb62-9dd4-4644-805f-e75f20f61ff9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:04:41.110673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b10fdb62-9dd4-4644-805f-e75f20f61ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:41.208015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 740/1494] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:04:41.216529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e7ba3-a300-4fea-aa4d-96d1da7fb496 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:41.217047 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e7ba3-a300-4fea-aa4d-96d1da7fb496 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:41.217156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e7ba3-a300-4fea-aa4d-96d1da7fb496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:41.292626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2d4e7ba3-a300-4fea-aa4d-96d1da7fb496 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:04:41.293744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2d4e7ba3-a300-4fea-aa4d-96d1da7fb496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:41.393964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 755/1495] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:04:41.398592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fdb62-9dd4-4644-805f-e75f20f61ff9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:04:41.399811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b10fdb62-9dd4-4644-805f-e75f20f61ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:41.412112 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fdb62-9dd4-4644-805f-e75f20f61ff9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:04:41.472815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:41.506494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:04:41.507128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:41.507411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:41.507685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:41.508343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:04:41.508678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:04:41.509719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WARNING py.warnings [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:04:41.509719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 01:04:41.509719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: Aug 31 01:04:41.510611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:04:41.522301 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 741/1496] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:04:41.530577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e7ba3-a300-4fea-aa4d-96d1da7fb496 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:04:41.540176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e7ba3-a300-4fea-aa4d-96d1da7fb496 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:04:41.599448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:41.632713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80211a-f9c9-48a6-a427-b423802124bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:04:41.633312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80211a-f9c9-48a6-a427-b423802124bb admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:41.633591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80211a-f9c9-48a6-a427-b423802124bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:41.633856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80211a-f9c9-48a6-a427-b423802124bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:41.634477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80211a-f9c9-48a6-a427-b423802124bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:04:41.636185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-3e80211a-f9c9-48a6-a427-b423802124bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:04:41.636185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 01:04:41.636185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: Aug 31 01:04:41.637405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80211a-f9c9-48a6-a427-b423802124bb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:04:41.694262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 756/1497] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:04:41 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:04:41.698381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:04:41.699888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:41.733729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f826-3087-4df7-bbd1-262702051fcb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:04:41.831300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e066bb-2efb-43d6-a926-2790526120ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:04:41.831915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e066bb-2efb-43d6-a926-2790526120ae admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:41.832200 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e066bb-2efb-43d6-a926-2790526120ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:41.832508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e066bb-2efb-43d6-a926-2790526120ae admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:41.833183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e066bb-2efb-43d6-a926-2790526120ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:04:41.834199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WARNING py.warnings [None req-04e066bb-2efb-43d6-a926-2790526120ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:04:41.834199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 01:04:41.834199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: Aug 31 01:04:41.835663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e066bb-2efb-43d6-a926-2790526120ae admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:04:41.877572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 742/1498] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:04:41 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:04:41.881625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80211a-f9c9-48a6-a427-b423802124bb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:04:41.883137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3e80211a-f9c9-48a6-a427-b423802124bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:41.943354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80211a-f9c9-48a6-a427-b423802124bb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:04:42.025373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:42.036825 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35e69-a210-4dc1-8962-06392e80f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:04:42.037435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35e69-a210-4dc1-8962-06392e80f35c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:42.037712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35e69-a210-4dc1-8962-06392e80f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:42.037985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35e69-a210-4dc1-8962-06392e80f35c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:42.038622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a35e69-a210-4dc1-8962-06392e80f35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:04:42.039622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-70a35e69-a210-4dc1-8962-06392e80f35c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:04:42.039622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 01:04:42.039622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: Aug 31 01:04:42.040535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a35e69-a210-4dc1-8962-06392e80f35c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:04:42.053156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 757/1499] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:04:42.057174 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e066bb-2efb-43d6-a926-2790526120ae admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:04:42.058680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-04e066bb-2efb-43d6-a926-2790526120ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:42.070825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e066bb-2efb-43d6-a926-2790526120ae admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:04:42.098399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:42.170609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca6ef0-b3c4-419a-9684-3d362bb5b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:04:42.171226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca6ef0-b3c4-419a-9684-3d362bb5b6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:42.171512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca6ef0-b3c4-419a-9684-3d362bb5b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:42.171791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca6ef0-b3c4-419a-9684-3d362bb5b6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:42.172978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca6ef0-b3c4-419a-9684-3d362bb5b6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:04:42.174144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WARNING py.warnings [None req-05ca6ef0-b3c4-419a-9684-3d362bb5b6a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:04:42.174144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 01:04:42.174144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: Aug 31 01:04:42.175034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca6ef0-b3c4-419a-9684-3d362bb5b6a8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:04:42.187272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 743/1500] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:04:42.192194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35e69-a210-4dc1-8962-06392e80f35c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:04:42.193951 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-70a35e69-a210-4dc1-8962-06392e80f35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:42.226909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35e69-a210-4dc1-8962-06392e80f35c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:04:42.319337 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bf216-9b97-4c2f-8a89-6485ca8960b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:04:42.319991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf216-9b97-4c2f-8a89-6485ca8960b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:42.320274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf216-9b97-4c2f-8a89-6485ca8960b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:42.320578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf216-9b97-4c2f-8a89-6485ca8960b2 admin admin] PATH_INFO: `/v3/projects/5ad4cffaf11a43eeb2e8fff3ad916e9b/users/d212e91f75324c7a96749bc11b5a8b79/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:42.342889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bf216-9b97-4c2f-8a89-6485ca8960b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad4cffaf11a43eeb2e8fff3ad916e9b, user_id=d212e91f75324c7a96749bc11b5a8b79, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:04:42.343917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-8d4bf216-9b97-4c2f-8a89-6485ca8960b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:04:42.343917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 01:04:42.343917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: Aug 31 01:04:42.346150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bf216-9b97-4c2f-8a89-6485ca8960b2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:04:42.371865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 758/1501] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:04:42 2022] PUT /identity/v3/projects/5ad4cffaf11a43eeb2e8fff3ad916e9b/users/d212e91f75324c7a96749bc11b5a8b79/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:04:42.384833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded8fea-8521-4e31-a117-c8182a846eff None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:42.385048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded8fea-8521-4e31-a117-c8182a846eff None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:42.385323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded8fea-8521-4e31-a117-c8182a846eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:42.442210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4ded8fea-8521-4e31-a117-c8182a846eff None None] MFA Rules not processed for user `d212e91f75324c7a96749bc11b5a8b79`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:04:42.443421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4ded8fea-8521-4e31-a117-c8182a846eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:42.520208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 744/1502] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:04:42.533358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878f6ad-3151-4879-92bb-0dfa613e0d91 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:42.533651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878f6ad-3151-4879-92bb-0dfa613e0d91 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:42.533931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878f6ad-3151-4879-92bb-0dfa613e0d91 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:42.535292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 759/1503] 10.222.0.83 () {54 vars in 964 bytes} [Wed Aug 31 01:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 01:04:42.540158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e5855-0be2-4a2d-b0cc-16d0257644f9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:42.540486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e5855-0be2-4a2d-b0cc-16d0257644f9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:42.540770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e5855-0be2-4a2d-b0cc-16d0257644f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:42.571598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:42.616962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-549e5855-0be2-4a2d-b0cc-16d0257644f9 None None] MFA Rules not processed for user `376dd413b33c4f4987f6bba3b14f3bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:04:42.618175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-549e5855-0be2-4a2d-b0cc-16d0257644f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:42.694649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 745/1504] 10.222.0.83 () {58 vars in 1061 bytes} [Wed Aug 31 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:04:42.702604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878f6ad-3151-4879-92bb-0dfa613e0d91 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:04:42.704868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7878f6ad-3151-4879-92bb-0dfa613e0d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:42.756049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:42.812114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878f6ad-3151-4879-92bb-0dfa613e0d91 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:04:42.886848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606cd2e-9bd2-452b-964c-b04288195c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:04:42.887484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606cd2e-9bd2-452b-964c-b04288195c5d service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:42.887765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606cd2e-9bd2-452b-964c-b04288195c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:42.888040 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606cd2e-9bd2-452b-964c-b04288195c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:42.889678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2606cd2e-9bd2-452b-964c-b04288195c5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:42.986700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606cd2e-9bd2-452b-964c-b04288195c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:04:42.988045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606cd2e-9bd2-452b-964c-b04288195c5d service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:04:42.991477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:43.006043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 760/1505] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:04:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:04:43.051587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac04f9-1e4e-4483-9b50-e50e510f7569 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:43.051879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac04f9-1e4e-4483-9b50-e50e510f7569 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:43.052159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac04f9-1e4e-4483-9b50-e50e510f7569 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:43.053463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 746/1506] 10.222.0.83 () {52 vars in 830 bytes} [Wed Aug 31 01:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:04:43.057098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606cd2e-9bd2-452b-964c-b04288195c5d service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:04:43.058344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2606cd2e-9bd2-452b-964c-b04288195c5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:43.159164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606cd2e-9bd2-452b-964c-b04288195c5d service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:04:43.252389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:04:43.253049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:43.253224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:43.253503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] PATH_INFO: `/v3/users/d212e91f75324c7a96749bc11b5a8b79` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:43.265612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d212e91f75324c7a96749bc11b5a8b79)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:04:43.267310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:04:43.267310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 01:04:43.267310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: Aug 31 01:04:43.268585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:04:43.278041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:43.335332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd212e91f75324c7a96749bc11b5a8b79'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:04:43.336169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd212e91f75324c7a96749bc11b5a8b79'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:04:43.345351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd212e91f75324c7a96749bc11b5a8b79'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:04:43.371380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd212e91f75324c7a96749bc11b5a8b79'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:04:43.390942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd212e91f75324c7a96749bc11b5a8b79'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:04:43.397534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 761/1507] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:04:43 2022] DELETE /identity/v3/users/d212e91f75324c7a96749bc11b5a8b79 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:04:43.401895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8b42-84cc-446c-b2f1-a8b5c56a9821 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:43.402390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8b42-84cc-446c-b2f1-a8b5c56a9821 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:43.402597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8b42-84cc-446c-b2f1-a8b5c56a9821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:43.459531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7c1d8b42-84cc-446c-b2f1-a8b5c56a9821 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:04:43.461051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7c1d8b42-84cc-446c-b2f1-a8b5c56a9821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:43.535965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:43.549937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 747/1508] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:04:43.559357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:04:43.560639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:43.659111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de3547-2d46-48ea-8eb0-98b6bf8e308a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:04:43.713972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:43.735262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0173e-b938-4b9f-b8b7-879ced24ac5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:04:43.736012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0173e-b938-4b9f-b8b7-879ced24ac5a service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:43.736306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0173e-b938-4b9f-b8b7-879ced24ac5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:43.736689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0173e-b938-4b9f-b8b7-879ced24ac5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:43.738287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0ce0173e-b938-4b9f-b8b7-879ced24ac5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:43.845276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0173e-b938-4b9f-b8b7-879ced24ac5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:04:43.846637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0173e-b938-4b9f-b8b7-879ced24ac5a service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:04:43.865145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 762/1509] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:04:44.233008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d8b42-84cc-446c-b2f1-a8b5c56a9821 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:04:44.234243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7c1d8b42-84cc-446c-b2f1-a8b5c56a9821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:04:44.246498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d8b42-84cc-446c-b2f1-a8b5c56a9821 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:04:44.348811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:04:44.349537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:04:44.349754 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:04:44.350027 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] PATH_INFO: `/v3/projects/5ad4cffaf11a43eeb2e8fff3ad916e9b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:04:44.359634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad4cffaf11a43eeb2e8fff3ad916e9b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:04:44.360812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WARNING py.warnings [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:04:44.360812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 01:04:44.360812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: Aug 31 01:04:44.362014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:04:44.419225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad4cffaf11a43eeb2e8fff3ad916e9b', 'request_id': 'req-3b5d54d8-3747-45b0-bc9a-24170efa3056'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:04:44.425680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad4cffaf11a43eeb2e8fff3ad916e9b', 'request_id': 'req-3b5d54d8-3747-45b0-bc9a-24170efa3056'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:04:44.440259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad4cffaf11a43eeb2e8fff3ad916e9b', 'request_id': 'req-3b5d54d8-3747-45b0-bc9a-24170efa3056'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:04:44.470034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] The token cache is being invalidate because project 5ad4cffaf11a43eeb2e8fff3ad916e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:04:44.470034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:04:44.470255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3b5d54d8-3747-45b0-bc9a-24170efa3056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:04:44.471726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 748/1510] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:04:44 2022] DELETE /identity/v3/projects/5ad4cffaf11a43eeb2e8fff3ad916e9b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:04:53.862893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=62 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:54.466760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:06:23.852519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dac09-7517-484b-8466-ea34c9939651 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:23.857277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dac09-7517-484b-8466-ea34c9939651 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:23.857277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dac09-7517-484b-8466-ea34c9939651 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:23.857277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:06:23.860202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a302c-e036-45e3-a081-2bb6fd5bae8e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:23.860699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a302c-e036-45e3-a081-2bb6fd5bae8e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:23.860818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a302c-e036-45e3-a081-2bb6fd5bae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:23.942354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4a7a302c-e036-45e3-a081-2bb6fd5bae8e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:06:23.943553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4a7a302c-e036-45e3-a081-2bb6fd5bae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:24.044675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:06:24.196559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dac09-7517-484b-8466-ea34c9939651 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:06:24.198694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3c0dac09-7517-484b-8466-ea34c9939651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:24.317679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dac09-7517-484b-8466-ea34c9939651 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:06:24.323100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3e8d2-e442-4baa-bff2-9479d35ace64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:06:24.323731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3e8d2-e442-4baa-bff2-9479d35ace64 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:24.324013 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3e8d2-e442-4baa-bff2-9479d35ace64 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:24.324285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3e8d2-e442-4baa-bff2-9479d35ace64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:24.333051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3e8d2-e442-4baa-bff2-9479d35ace64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:06:24.334871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3e8d2-e442-4baa-bff2-9479d35ace64 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:06:24.344057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 764/1513] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:06:25.177275 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59ed3b-318b-4ab3-b20a-0275cff8db61 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:25.177752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59ed3b-318b-4ab3-b20a-0275cff8db61 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:25.177863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59ed3b-318b-4ab3-b20a-0275cff8db61 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:25.179212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:06:25.184108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f030-c235-4471-8c9f-047bd5ac4a8f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:25.184575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f030-c235-4471-8c9f-047bd5ac4a8f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:25.184777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f030-c235-4471-8c9f-047bd5ac4a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:25.203940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c766f030-c235-4471-8c9f-047bd5ac4a8f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:06:25.205174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c766f030-c235-4471-8c9f-047bd5ac4a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:25.213366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:06:25.367088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59ed3b-318b-4ab3-b20a-0275cff8db61 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:06:25.381749 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59ed3b-318b-4ab3-b20a-0275cff8db61 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:06:25.387273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f29c8-9ef8-48c9-8504-6c446d047685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:06:25.387875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f29c8-9ef8-48c9-8504-6c446d047685 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:25.388159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f29c8-9ef8-48c9-8504-6c446d047685 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:25.388475 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f29c8-9ef8-48c9-8504-6c446d047685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:25.396723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f29c8-9ef8-48c9-8504-6c446d047685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:06:25.398304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f29c8-9ef8-48c9-8504-6c446d047685 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:06:25.408284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 751/1516] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:06:28.418678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb4362-2927-46d2-ab43-48a512b16f5c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:28.419221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb4362-2927-46d2-ab43-48a512b16f5c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:28.419221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb4362-2927-46d2-ab43-48a512b16f5c None None] PATH_INFO: `/v3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:28.420467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 766/1517] 10.222.0.27 () {54 vars in 925 bytes} [Wed Aug 31 01:06:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:06:28.428300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8fba4-2894-4db0-90c1-9b364dea3334 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:28.428753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8fba4-2894-4db0-90c1-9b364dea3334 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:28.428876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8fba4-2894-4db0-90c1-9b364dea3334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:28.487967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fbc8fba4-2894-4db0-90c1-9b364dea3334 None None] MFA Rules not processed for user `1eb93baf45174c10a6fcbe321ac65764`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:06:28.489197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fbc8fba4-2894-4db0-90c1-9b364dea3334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:28.505433 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:06:28.559704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 752/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 31 01:06:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:06:33.061639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb747e70-e9ba-4142-a7e7-3dd20f4ca28d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:33.062172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb747e70-e9ba-4142-a7e7-3dd20f4ca28d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:33.062172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb747e70-e9ba-4142-a7e7-3dd20f4ca28d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:33.063490 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 767/1519] 10.222.0.83 () {54 vars in 961 bytes} [Wed Aug 31 01:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:06:33.068727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c9c17-d7f7-4e79-b8fe-c811e79a9281 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:33.069174 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c9c17-d7f7-4e79-b8fe-c811e79a9281 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:33.069282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c9c17-d7f7-4e79-b8fe-c811e79a9281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:33.089147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ac1c9c17-d7f7-4e79-b8fe-c811e79a9281 None None] MFA Rules not processed for user `1eb93baf45174c10a6fcbe321ac65764`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:06:33.090322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ac1c9c17-d7f7-4e79-b8fe-c811e79a9281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:33.099371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 753/1520] 10.222.0.83 () {58 vars in 1058 bytes} [Wed Aug 31 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:06:33.106842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb747e70-e9ba-4142-a7e7-3dd20f4ca28d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:06:33.120644 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb747e70-e9ba-4142-a7e7-3dd20f4ca28d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:06:33.125663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692f86a-baff-43ba-b789-b93ded55dedb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:06:33.126953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f86a-baff-43ba-b789-b93ded55dedb service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:33.127232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f86a-baff-43ba-b789-b93ded55dedb service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:33.127511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f86a-baff-43ba-b789-b93ded55dedb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:33.135947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692f86a-baff-43ba-b789-b93ded55dedb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:06:33.137608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692f86a-baff-43ba-b789-b93ded55dedb service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:06:33.147554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 768/1521] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:06:36.645305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea622c3-e0ba-4d26-9eab-259b7552cc6f None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:36.645829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea622c3-e0ba-4d26-9eab-259b7552cc6f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:36.645921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea622c3-e0ba-4d26-9eab-259b7552cc6f None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:36.647244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:06:36.652968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05a711-f643-414f-b228-6a7a20f1e5cb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:36.653441 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05a711-f643-414f-b228-6a7a20f1e5cb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:36.653552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05a711-f643-414f-b228-6a7a20f1e5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:36.676917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4c05a711-f643-414f-b228-6a7a20f1e5cb None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:06:36.678114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4c05a711-f643-414f-b228-6a7a20f1e5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:36.685929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:06:36.850236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea622c3-e0ba-4d26-9eab-259b7552cc6f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:06:36.865794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea622c3-e0ba-4d26-9eab-259b7552cc6f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:06:36.871253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6669977-4283-4037-832f-fdeb8b955e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:06:36.871860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669977-4283-4037-832f-fdeb8b955e6c service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:36.872141 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669977-4283-4037-832f-fdeb8b955e6c service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:36.872443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669977-4283-4037-832f-fdeb8b955e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:36.881952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6669977-4283-4037-832f-fdeb8b955e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:06:36.883521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6669977-4283-4037-832f-fdeb8b955e6c service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:06:36.893363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 755/1524] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:06:37.715612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb69d4-e095-41e7-bbb3-70d5384e62e9 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:37.716186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb69d4-e095-41e7-bbb3-70d5384e62e9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:37.716186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb69d4-e095-41e7-bbb3-70d5384e62e9 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:37.717573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 01:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:06:37.723233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682608a-969e-4296-9867-1024787b995a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:37.723675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682608a-969e-4296-9867-1024787b995a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:37.723771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682608a-969e-4296-9867-1024787b995a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:37.743608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f682608a-969e-4296-9867-1024787b995a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:06:37.744827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f682608a-969e-4296-9867-1024787b995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:37.752657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:06:37.904153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb69d4-e095-41e7-bbb3-70d5384e62e9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:06:37.919115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb69d4-e095-41e7-bbb3-70d5384e62e9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:06:37.925566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38446aa-65c2-4051-904f-f8ddfa4f3aa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:06:37.926163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38446aa-65c2-4051-904f-f8ddfa4f3aa2 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:37.926446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38446aa-65c2-4051-904f-f8ddfa4f3aa2 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:37.926724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38446aa-65c2-4051-904f-f8ddfa4f3aa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:37.935013 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38446aa-65c2-4051-904f-f8ddfa4f3aa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:06:37.936619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38446aa-65c2-4051-904f-f8ddfa4f3aa2 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:06:37.946035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 771/1527] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:06:41.816038 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4ce43-cb8d-4898-af4a-857626ff50de None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:41.816643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4ce43-cb8d-4898-af4a-857626ff50de None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:41.816643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4ce43-cb8d-4898-af4a-857626ff50de None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:41.818138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:06:41.823968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd02ca-d7a1-40c3-b3a2-89117d5f97fe None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:41.824449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd02ca-d7a1-40c3-b3a2-89117d5f97fe None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:41.824572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd02ca-d7a1-40c3-b3a2-89117d5f97fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:41.843988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fbfd02ca-d7a1-40c3-b3a2-89117d5f97fe None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:06:41.845883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fbfd02ca-d7a1-40c3-b3a2-89117d5f97fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:41.853625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:06:42.150119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4ce43-cb8d-4898-af4a-857626ff50de None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:06:42.151830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-34c4ce43-cb8d-4898-af4a-857626ff50de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:42.232046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4ce43-cb8d-4898-af4a-857626ff50de None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:06:42.236220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948585-cc66-4e0b-a88d-63c0c752b27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:06:42.236863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948585-cc66-4e0b-a88d-63c0c752b27c service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:42.237146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948585-cc66-4e0b-a88d-63c0c752b27c service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:42.237424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948585-cc66-4e0b-a88d-63c0c752b27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:42.246366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63948585-cc66-4e0b-a88d-63c0c752b27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:06:42.247792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63948585-cc66-4e0b-a88d-63c0c752b27c service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:06:42.258412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 758/1530] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:06:44.158401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac4322-3b21-4dff-ab36-ad7f4368a157 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:44.158877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac4322-3b21-4dff-ab36-ad7f4368a157 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:44.159004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac4322-3b21-4dff-ab36-ad7f4368a157 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:44.160302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:06:44.165471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8042d-ba5e-4921-b749-66819cb21f6f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:44.165931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8042d-ba5e-4921-b749-66819cb21f6f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:44.166030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8042d-ba5e-4921-b749-66819cb21f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:44.185772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b9a8042d-ba5e-4921-b749-66819cb21f6f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:06:44.186969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b9a8042d-ba5e-4921-b749-66819cb21f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:44.195003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:06:44.485560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac4322-3b21-4dff-ab36-ad7f4368a157 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:06:44.496482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac4322-3b21-4dff-ab36-ad7f4368a157 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:06:44.500033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15a6e-a1c4-485b-ae9a-043a3a6c64c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:06:44.500683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15a6e-a1c4-485b-ae9a-043a3a6c64c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:44.501173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15a6e-a1c4-485b-ae9a-043a3a6c64c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:44.501546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15a6e-a1c4-485b-ae9a-043a3a6c64c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:44.510349 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a15a6e-a1c4-485b-ae9a-043a3a6c64c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:06:44.511773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a15a6e-a1c4-485b-ae9a-043a3a6c64c7 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:06:44.521628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 774/1533] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:06:47.937577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a72c-2fe1-47c6-8062-1292ddb32558 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:47.938123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a72c-2fe1-47c6-8062-1292ddb32558 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:47.938123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a72c-2fe1-47c6-8062-1292ddb32558 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:47.939503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:06:47.944990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adf7eb-1526-4dfc-8703-b3567fe17e80 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:47.945403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adf7eb-1526-4dfc-8703-b3567fe17e80 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:47.945597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adf7eb-1526-4dfc-8703-b3567fe17e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:47.965898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-91adf7eb-1526-4dfc-8703-b3567fe17e80 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:06:47.967102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-91adf7eb-1526-4dfc-8703-b3567fe17e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:47.975591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:06:48.533383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a72c-2fe1-47c6-8062-1292ddb32558 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:06:48.535061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2563a72c-2fe1-47c6-8062-1292ddb32558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:48.600143 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:06:48.613416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a72c-2fe1-47c6-8062-1292ddb32558 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:06:48.617031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e4ac-f474-4190-b1c8-ea53789c6ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:06:48.617640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e4ac-f474-4190-b1c8-ea53789c6ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:48.617923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e4ac-f474-4190-b1c8-ea53789c6ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:48.618199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e4ac-f474-4190-b1c8-ea53789c6ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:48.627672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094e4ac-f474-4190-b1c8-ea53789c6ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:06:48.629158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094e4ac-f474-4190-b1c8-ea53789c6ff3 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:06:48.638704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 761/1536] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:06:50.624453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c47d86-c0c4-4099-9def-2d7d032aea89 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:50.624976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c47d86-c0c4-4099-9def-2d7d032aea89 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:50.624976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c47d86-c0c4-4099-9def-2d7d032aea89 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:50.626224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 01:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:06:50.631687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9b98-4ea9-4a8c-b343-a38f2fe387e4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:50.632114 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9b98-4ea9-4a8c-b343-a38f2fe387e4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:50.632272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9b98-4ea9-4a8c-b343-a38f2fe387e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:50.654275 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a38d9b98-4ea9-4a8c-b343-a38f2fe387e4 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:06:50.656209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a38d9b98-4ea9-4a8c-b343-a38f2fe387e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:50.665055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 01:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:06:51.248131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c47d86-c0c4-4099-9def-2d7d032aea89 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:06:51.249834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-19c47d86-c0c4-4099-9def-2d7d032aea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:06:51.263443 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c47d86-c0c4-4099-9def-2d7d032aea89 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:06:51.267180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65b5ce-b14f-4da7-987c-390a9929872b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:06:51.267789 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65b5ce-b14f-4da7-987c-390a9929872b service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:06:51.268071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65b5ce-b14f-4da7-987c-390a9929872b service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:06:51.268379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65b5ce-b14f-4da7-987c-390a9929872b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:06:51.277235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65b5ce-b14f-4da7-987c-390a9929872b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:06:51.278655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65b5ce-b14f-4da7-987c-390a9929872b service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:06:51.288658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 777/1539] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:07:00.648810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=11 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:07:01.284427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:20.480155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1277da-31fb-466a-84eb-b24029032340 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.480807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1277da-31fb-466a-84eb-b24029032340 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.480807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1277da-31fb-466a-84eb-b24029032340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.512637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0c1277da-31fb-466a-84eb-b24029032340 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:20.513900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0c1277da-31fb-466a-84eb-b24029032340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:20.526435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 763/1540] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:20.535986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67f6e-6d1a-4937-8076-91d0d7ac1c8c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.539433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67f6e-6d1a-4937-8076-91d0d7ac1c8c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.539433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67f6e-6d1a-4937-8076-91d0d7ac1c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.567711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-65d67f6e-6d1a-4937-8076-91d0d7ac1c8c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:20.569006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-65d67f6e-6d1a-4937-8076-91d0d7ac1c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:20.577888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 778/1541] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:20.583355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1277da-31fb-466a-84eb-b24029032340 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:20.594009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1277da-31fb-466a-84eb-b24029032340 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:20.610156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50a147-1e5f-48ca-ab28-c58df0ca5492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:20.611075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50a147-1e5f-48ca-ab28-c58df0ca5492 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.611362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50a147-1e5f-48ca-ab28-c58df0ca5492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.611642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50a147-1e5f-48ca-ab28-c58df0ca5492 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.612311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50a147-1e5f-48ca-ab28-c58df0ca5492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:20.612652 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50a147-1e5f-48ca-ab28-c58df0ca5492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:20.614933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50a147-1e5f-48ca-ab28-c58df0ca5492 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:20.633167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 764/1542] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:20.634062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de9a27-de65-4fed-a0bb-013037040173 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.634353 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de9a27-de65-4fed-a0bb-013037040173 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.634632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de9a27-de65-4fed-a0bb-013037040173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.643040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50a147-1e5f-48ca-ab28-c58df0ca5492 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:20.653802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50a147-1e5f-48ca-ab28-c58df0ca5492 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:20.665491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b9d61-8177-4e36-9824-e5ba23b6aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:20.666180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9d61-8177-4e36-9824-e5ba23b6aa1a admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.666644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9d61-8177-4e36-9824-e5ba23b6aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.666931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9d61-8177-4e36-9824-e5ba23b6aa1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.667585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b9d61-8177-4e36-9824-e5ba23b6aa1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:20.668638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WARNING py.warnings [None req-790b9d61-8177-4e36-9824-e5ba23b6aa1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:08:20.668638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 01:08:20.668638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: Aug 31 01:08:20.669872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b9d61-8177-4e36-9824-e5ba23b6aa1a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:20.673419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f9de9a27-de65-4fed-a0bb-013037040173 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:20.674631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f9de9a27-de65-4fed-a0bb-013037040173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:20.694250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 779/1543] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:08:20.695677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039fb9d-3ea4-467e-8839-2fc68c331641 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.695967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039fb9d-3ea4-467e-8839-2fc68c331641 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.696239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039fb9d-3ea4-467e-8839-2fc68c331641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.737885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e039fb9d-3ea4-467e-8839-2fc68c331641 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:20.739039 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e039fb9d-3ea4-467e-8839-2fc68c331641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:20.766194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 780/1544] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:20.767642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539574d-ee7f-4f72-825e-aceda872c1c3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.767937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539574d-ee7f-4f72-825e-aceda872c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.768215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539574d-ee7f-4f72-825e-aceda872c1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.768888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 765/1545] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:08:20.770923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb8bbd-487b-4b9f-bfea-579b976a5bbf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.771320 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb8bbd-487b-4b9f-bfea-579b976a5bbf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.771855 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb8bbd-487b-4b9f-bfea-579b976a5bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.804350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a539574d-ee7f-4f72-825e-aceda872c1c3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:20.804350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a539574d-ee7f-4f72-825e-aceda872c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:20.804694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4deb8bbd-487b-4b9f-bfea-579b976a5bbf None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:20.804694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4deb8bbd-487b-4b9f-bfea-579b976a5bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:20.909050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 781/1546] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:20.910539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262090f-59ca-4c58-ba1f-8f93dc6f5f34 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.910842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262090f-59ca-4c58-ba1f-8f93dc6f5f34 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.911119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262090f-59ca-4c58-ba1f-8f93dc6f5f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.917573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 766/1547] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:20.918594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb8bbd-487b-4b9f-bfea-579b976a5bbf None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:20.943377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb8bbd-487b-4b9f-bfea-579b976a5bbf None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:20.945451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6262090f-59ca-4c58-ba1f-8f93dc6f5f34 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:20.946679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6262090f-59ca-4c58-ba1f-8f93dc6f5f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:20.952828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fa594-0eb2-4872-9a63-510ffbd6ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:20.953563 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fa594-0eb2-4872-9a63-510ffbd6ff44 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.953953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fa594-0eb2-4872-9a63-510ffbd6ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.954490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fa594-0eb2-4872-9a63-510ffbd6ff44 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.955228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fa594-0eb2-4872-9a63-510ffbd6ff44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:20.957981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fa594-0eb2-4872-9a63-510ffbd6ff44 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:20.959265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 782/1548] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:20.961803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceedf5-519d-46a4-a21b-bc04ba768bf3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.962291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceedf5-519d-46a4-a21b-bc04ba768bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.962568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceedf5-519d-46a4-a21b-bc04ba768bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.980903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 767/1549] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/users => generated 283 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:20.983728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1ae91-58a7-4bf5-97ef-513b8758352d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:20.983861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e5ceedf5-519d-46a4-a21b-bc04ba768bf3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:20.983966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1ae91-58a7-4bf5-97ef-513b8758352d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:20.983966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1ae91-58a7-4bf5-97ef-513b8758352d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:20.984132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e5ceedf5-519d-46a4-a21b-bc04ba768bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:20.991716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 783/1550] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:20.992463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceedf5-519d-46a4-a21b-bc04ba768bf3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.002990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-dde1ae91-58a7-4bf5-97ef-513b8758352d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:21.004204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceedf5-519d-46a4-a21b-bc04ba768bf3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.004984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dde1ae91-58a7-4bf5-97ef-513b8758352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:21.008790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4a0b-cac0-4ba5-82a1-cd6497f24a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.009389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4a0b-cac0-4ba5-82a1-cd6497f24a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.009666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4a0b-cac0-4ba5-82a1-cd6497f24a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.009937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4a0b-cac0-4ba5-82a1-cd6497f24a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.010571 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b4a0b-cac0-4ba5-82a1-cd6497f24a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:21.010871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b4a0b-cac0-4ba5-82a1-cd6497f24a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.011863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-a56b4a0b-cac0-4ba5-82a1-cd6497f24a58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:08:21.011863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 01:08:21.011863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: Aug 31 01:08:21.012782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b4a0b-cac0-4ba5-82a1-cd6497f24a58 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.013550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 768/1551] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:21.014800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b158849-59b7-4462-a9f7-7b0d8472d259 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.015094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b158849-59b7-4462-a9f7-7b0d8472d259 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.015370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b158849-59b7-4462-a9f7-7b0d8472d259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.039429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 784/1552] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:21.039429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcbeec-fe47-4f25-9dbb-466ec6559655 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.039429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcbeec-fe47-4f25-9dbb-466ec6559655 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.039429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcbeec-fe47-4f25-9dbb-466ec6559655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.039885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4b158849-59b7-4462-a9f7-7b0d8472d259 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:21.039885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4b158849-59b7-4462-a9f7-7b0d8472d259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:21.046423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 769/1553] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:21.047928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57780465-8875-40fa-865f-e8af02a3bf64 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.048286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57780465-8875-40fa-865f-e8af02a3bf64 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.048652 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57780465-8875-40fa-865f-e8af02a3bf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.058360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-96fcbeec-fe47-4f25-9dbb-466ec6559655 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:21.059579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-96fcbeec-fe47-4f25-9dbb-466ec6559655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:21.068509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 785/1554] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:21.068902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-57780465-8875-40fa-865f-e8af02a3bf64 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:21.069291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcbeec-fe47-4f25-9dbb-466ec6559655 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.070147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-57780465-8875-40fa-865f-e8af02a3bf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:21.079851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 770/1555] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:21.088511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57780465-8875-40fa-865f-e8af02a3bf64 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.088697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcbeec-fe47-4f25-9dbb-466ec6559655 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.088697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67692ec8-4b4f-4700-886e-3acac1840597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.088697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67692ec8-4b4f-4700-886e-3acac1840597 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.089000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67692ec8-4b4f-4700-886e-3acac1840597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.089090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67692ec8-4b4f-4700-886e-3acac1840597 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.089675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67692ec8-4b4f-4700-886e-3acac1840597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:21.089989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67692ec8-4b4f-4700-886e-3acac1840597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.091588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67692ec8-4b4f-4700-886e-3acac1840597 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.097859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57780465-8875-40fa-865f-e8af02a3bf64 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.102926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f28e8a-3a0a-4b93-b7be-9907efc8360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.103535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f28e8a-3a0a-4b93-b7be-9907efc8360c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.103741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 786/1556] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:21.103857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f28e8a-3a0a-4b93-b7be-9907efc8360c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.104095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f28e8a-3a0a-4b93-b7be-9907efc8360c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.105055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f28e8a-3a0a-4b93-b7be-9907efc8360c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.105178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663b1c8-beeb-4d3a-b4f7-99abc6fdf6d9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.105450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663b1c8-beeb-4d3a-b4f7-99abc6fdf6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.105792 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663b1c8-beeb-4d3a-b4f7-99abc6fdf6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.106672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f28e8a-3a0a-4b93-b7be-9907efc8360c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.119901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 771/1557] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:21.119901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c74be-2bba-4097-a672-613ae9028bf9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.119901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c74be-2bba-4097-a672-613ae9028bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.119901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c74be-2bba-4097-a672-613ae9028bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.125882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9663b1c8-beeb-4d3a-b4f7-99abc6fdf6d9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:21.127094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9663b1c8-beeb-4d3a-b4f7-99abc6fdf6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:21.135822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 787/1558] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:21.136633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663b1c8-beeb-4d3a-b4f7-99abc6fdf6d9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.141952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-171c74be-2bba-4097-a672-613ae9028bf9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:21.143163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-171c74be-2bba-4097-a672-613ae9028bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:21.146437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663b1c8-beeb-4d3a-b4f7-99abc6fdf6d9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.151017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e16b6-55eb-467a-a7b1-031b95d60537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.151620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e16b6-55eb-467a-a7b1-031b95d60537 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.151900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e16b6-55eb-467a-a7b1-031b95d60537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.152176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e16b6-55eb-467a-a7b1-031b95d60537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.152300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 772/1559] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:21.152929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e16b6-55eb-467a-a7b1-031b95d60537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.153161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c74be-2bba-4097-a672-613ae9028bf9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.154938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e16b6-55eb-467a-a7b1-031b95d60537 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.166159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c74be-2bba-4097-a672-613ae9028bf9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.171350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7802d-b7dc-4de2-990a-52b9d4bbe7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.172037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7802d-b7dc-4de2-990a-52b9d4bbe7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.172498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7802d-b7dc-4de2-990a-52b9d4bbe7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.172688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7802d-b7dc-4de2-990a-52b9d4bbe7cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.173469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7802d-b7dc-4de2-990a-52b9d4bbe7cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:21.174353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7802d-b7dc-4de2-990a-52b9d4bbe7cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.176993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7802d-b7dc-4de2-990a-52b9d4bbe7cc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.184940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 788/1560] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:21.186180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033bc5-1381-4877-8f46-d7d81d2424ba None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.186468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033bc5-1381-4877-8f46-d7d81d2424ba None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.186740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033bc5-1381-4877-8f46-d7d81d2424ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.196448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 773/1561] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:21.196448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57173e2-2ba7-4c6e-b449-a10ce8fb4deb None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.196448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57173e2-2ba7-4c6e-b449-a10ce8fb4deb None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.196448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57173e2-2ba7-4c6e-b449-a10ce8fb4deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.205832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1e033bc5-1381-4877-8f46-d7d81d2424ba None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:21.207648 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1e033bc5-1381-4877-8f46-d7d81d2424ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:21.213594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a57173e2-2ba7-4c6e-b449-a10ce8fb4deb None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:21.214791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a57173e2-2ba7-4c6e-b449-a10ce8fb4deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:21.258291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:21.268563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 789/1562] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:21.270123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e033bc5-1381-4877-8f46-d7d81d2424ba None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.279179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e033bc5-1381-4877-8f46-d7d81d2424ba None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.281956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 774/1563] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:21.282651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57173e2-2ba7-4c6e-b449-a10ce8fb4deb None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.283767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205a052-63e1-4ffd-a925-a4d0cad87a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.284385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a052-63e1-4ffd-a925-a4d0cad87a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.284685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a052-63e1-4ffd-a925-a4d0cad87a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.285529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a052-63e1-4ffd-a925-a4d0cad87a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.286327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205a052-63e1-4ffd-a925-a4d0cad87a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.288131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205a052-63e1-4ffd-a925-a4d0cad87a6a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.292602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57173e2-2ba7-4c6e-b449-a10ce8fb4deb None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.292807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:21.297707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76375be-386a-41e4-a9fe-b11deb0d7c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.298368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76375be-386a-41e4-a9fe-b11deb0d7c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.298657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76375be-386a-41e4-a9fe-b11deb0d7c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.299014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76375be-386a-41e4-a9fe-b11deb0d7c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.299577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76375be-386a-41e4-a9fe-b11deb0d7c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.301383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76375be-386a-41e4-a9fe-b11deb0d7c67 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.311989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 775/1564] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:21.313393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76375be-386a-41e4-a9fe-b11deb0d7c67 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.322150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 790/1565] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:21.322150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205a052-63e1-4ffd-a925-a4d0cad87a6a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.323331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76375be-386a-41e4-a9fe-b11deb0d7c67 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.382989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205a052-63e1-4ffd-a925-a4d0cad87a6a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.384739 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e6bc-2c28-4f5e-8bba-7bd497f2f886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.385445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e6bc-2c28-4f5e-8bba-7bd497f2f886 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.385726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e6bc-2c28-4f5e-8bba-7bd497f2f886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.386000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e6bc-2c28-4f5e-8bba-7bd497f2f886 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.386645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24e6bc-2c28-4f5e-8bba-7bd497f2f886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:21.386952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24e6bc-2c28-4f5e-8bba-7bd497f2f886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.387978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029d3f3-595f-43b1-bd48-0216974d4e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.388576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24e6bc-2c28-4f5e-8bba-7bd497f2f886 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.388697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029d3f3-595f-43b1-bd48-0216974d4e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.388964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029d3f3-595f-43b1-bd48-0216974d4e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.389244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029d3f3-595f-43b1-bd48-0216974d4e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.389897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029d3f3-595f-43b1-bd48-0216974d4e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:21.390207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029d3f3-595f-43b1-bd48-0216974d4e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.391813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029d3f3-595f-43b1-bd48-0216974d4e1d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.401546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 776/1566] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:21.402423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e6bc-2c28-4f5e-8bba-7bd497f2f886 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.409512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 791/1567] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:21.411173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029d3f3-595f-43b1-bd48-0216974d4e1d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.412671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e6bc-2c28-4f5e-8bba-7bd497f2f886 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.417406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfcf54-d10c-4f00-b38e-9309c86700ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.418010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfcf54-d10c-4f00-b38e-9309c86700ea admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.418291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfcf54-d10c-4f00-b38e-9309c86700ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.418565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfcf54-d10c-4f00-b38e-9309c86700ea admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.419194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfcf54-d10c-4f00-b38e-9309c86700ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.421141 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfcf54-d10c-4f00-b38e-9309c86700ea admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.421461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029d3f3-595f-43b1-bd48-0216974d4e1d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.426084 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6fc54-e003-4162-88c1-7cb6946a45ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.426671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6fc54-e003-4162-88c1-7cb6946a45ac admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.426948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6fc54-e003-4162-88c1-7cb6946a45ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.427252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6fc54-e003-4162-88c1-7cb6946a45ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.427869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6fc54-e003-4162-88c1-7cb6946a45ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.429782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6fc54-e003-4162-88c1-7cb6946a45ac admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.446772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 777/1568] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:21.446772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfcf54-d10c-4f00-b38e-9309c86700ea admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.454179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfcf54-d10c-4f00-b38e-9309c86700ea admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.459613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53bd40-35cd-4e3b-86da-aef54fc78659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.460206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53bd40-35cd-4e3b-86da-aef54fc78659 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.460518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53bd40-35cd-4e3b-86da-aef54fc78659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.460798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53bd40-35cd-4e3b-86da-aef54fc78659 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.460939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 792/1569] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:21.461459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53bd40-35cd-4e3b-86da-aef54fc78659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:21.461662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6fc54-e003-4162-88c1-7cb6946a45ac admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.461774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53bd40-35cd-4e3b-86da-aef54fc78659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.463331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53bd40-35cd-4e3b-86da-aef54fc78659 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.481406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 778/1570] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:21.481406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53bd40-35cd-4e3b-86da-aef54fc78659 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.492700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53bd40-35cd-4e3b-86da-aef54fc78659 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.525442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6fc54-e003-4162-88c1-7cb6946a45ac admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.530246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b671c-0133-44a3-828c-c6d1e713a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.530877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b671c-0133-44a3-828c-c6d1e713a08c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.531195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b671c-0133-44a3-828c-c6d1e713a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.531476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b671c-0133-44a3-828c-c6d1e713a08c admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.532121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b671c-0133-44a3-828c-c6d1e713a08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:21.532455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b671c-0133-44a3-828c-c6d1e713a08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.534050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b671c-0133-44a3-828c-c6d1e713a08c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.545822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 793/1571] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:21.546670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b671c-0133-44a3-828c-c6d1e713a08c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.554708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afbd40-be0b-4390-88c6-acef8ec182e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.555408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afbd40-be0b-4390-88c6-acef8ec182e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.555693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afbd40-be0b-4390-88c6-acef8ec182e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.555967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afbd40-be0b-4390-88c6-acef8ec182e0 admin admin] PATH_INFO: `/v3/projects/5671acdf67bc4b7ab752ffc085ef753d/users/82e631d78c544a9f926836c58423f39b/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.561058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b671c-0133-44a3-828c-c6d1e713a08c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.565782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9352d02-3d93-4e49-b9b3-699e6297e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.567299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9352d02-3d93-4e49-b9b3-699e6297e57c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.567582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9352d02-3d93-4e49-b9b3-699e6297e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.567940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9352d02-3d93-4e49-b9b3-699e6297e57c admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.568531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9352d02-3d93-4e49-b9b3-699e6297e57c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.569644 dv-cinder-855288-2-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-d9352d02-3d93-4e49-b9b3-699e6297e57c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:08:21.569644 dv-cinder-855288-2-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 01:08:21.569644 dv-cinder-855288-2-smb devstack@keystone.service[81484]: Aug 31 01:08:21.570909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9352d02-3d93-4e49-b9b3-699e6297e57c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.572002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afbd40-be0b-4390-88c6-acef8ec182e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5671acdf67bc4b7ab752ffc085ef753d, user_id=82e631d78c544a9f926836c58423f39b, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.573076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WARNING py.warnings [None req-16afbd40-be0b-4390-88c6-acef8ec182e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:08:21.573076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 01:08:21.573076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: Aug 31 01:08:21.575003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afbd40-be0b-4390-88c6-acef8ec182e0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.589353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 779/1572] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:21 2022] PUT /identity/v3/projects/5671acdf67bc4b7ab752ffc085ef753d/users/82e631d78c544a9f926836c58423f39b/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:21.590365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afbd40-be0b-4390-88c6-acef8ec182e0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.595599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 794/1573] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:21.595599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9352d02-3d93-4e49-b9b3-699e6297e57c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.604523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9352d02-3d93-4e49-b9b3-699e6297e57c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.612477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:21.637797 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:21.658954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afbd40-be0b-4390-88c6-acef8ec182e0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.664529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10b088-dd6f-4223-a70e-97cf1c59d881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.665143 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10b088-dd6f-4223-a70e-97cf1c59d881 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.665515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10b088-dd6f-4223-a70e-97cf1c59d881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.665796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10b088-dd6f-4223-a70e-97cf1c59d881 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.666466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10b088-dd6f-4223-a70e-97cf1c59d881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.667852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21587db1-eb41-4794-a936-435c028f3c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.668398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10b088-dd6f-4223-a70e-97cf1c59d881 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.668525 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21587db1-eb41-4794-a936-435c028f3c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.668781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21587db1-eb41-4794-a936-435c028f3c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.669061 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21587db1-eb41-4794-a936-435c028f3c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.669701 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21587db1-eb41-4794-a936-435c028f3c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.671646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21587db1-eb41-4794-a936-435c028f3c25 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.700995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 780/1574] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:21.700995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10b088-dd6f-4223-a70e-97cf1c59d881 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.701328 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 795/1575] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:21.701328 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21587db1-eb41-4794-a936-435c028f3c25 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.763464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10b088-dd6f-4223-a70e-97cf1c59d881 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.765103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21587db1-eb41-4794-a936-435c028f3c25 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.768336 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd37483-f6b3-46f5-bd53-8f6f69fb9954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.768952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd37483-f6b3-46f5-bd53-8f6f69fb9954 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.769456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd37483-f6b3-46f5-bd53-8f6f69fb9954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.769696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0176b1-9072-4207-99f9-128f71410891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.769830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd37483-f6b3-46f5-bd53-8f6f69fb9954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.770299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0176b1-9072-4207-99f9-128f71410891 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.770420 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd37483-f6b3-46f5-bd53-8f6f69fb9954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.770585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0176b1-9072-4207-99f9-128f71410891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.770859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0176b1-9072-4207-99f9-128f71410891 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.771482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0176b1-9072-4207-99f9-128f71410891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.772039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd37483-f6b3-46f5-bd53-8f6f69fb9954 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.773421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0176b1-9072-4207-99f9-128f71410891 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.786070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 781/1576] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:21.786070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd37483-f6b3-46f5-bd53-8f6f69fb9954 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.796579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 796/1577] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:21.796865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd37483-f6b3-46f5-bd53-8f6f69fb9954 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.797264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0176b1-9072-4207-99f9-128f71410891 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.802806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39e85-8c7c-4267-8cde-48be24004128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.803501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39e85-8c7c-4267-8cde-48be24004128 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.803788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39e85-8c7c-4267-8cde-48be24004128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.804067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39e85-8c7c-4267-8cde-48be24004128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.804737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d39e85-8c7c-4267-8cde-48be24004128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.806653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d39e85-8c7c-4267-8cde-48be24004128 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.807953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0176b1-9072-4207-99f9-128f71410891 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.812871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddb510-ffa0-492a-b83d-8e5c6dec9572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.813467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddb510-ffa0-492a-b83d-8e5c6dec9572 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.813748 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddb510-ffa0-492a-b83d-8e5c6dec9572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.814021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddb510-ffa0-492a-b83d-8e5c6dec9572 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.814646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddb510-ffa0-492a-b83d-8e5c6dec9572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.816698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddb510-ffa0-492a-b83d-8e5c6dec9572 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.833933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 782/1578] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:21.834879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39e85-8c7c-4267-8cde-48be24004128 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.851756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 797/1579] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:21.851756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81d98-7005-43fb-936b-31c2239af8cc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.851756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81d98-7005-43fb-936b-31c2239af8cc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.851756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81d98-7005-43fb-936b-31c2239af8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.877764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d6c81d98-7005-43fb-936b-31c2239af8cc None None] MFA Rules not processed for user `82e631d78c544a9f926836c58423f39b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:21.879226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d6c81d98-7005-43fb-936b-31c2239af8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:21.902300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39e85-8c7c-4267-8cde-48be24004128 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.922940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:21.944070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 798/1580] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:21.947950 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81d98-7005-43fb-936b-31c2239af8cc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.964375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd49c2-c454-4312-8dbc-0a6b5d23085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.965208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd49c2-c454-4312-8dbc-0a6b5d23085a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.965364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:21.965466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd49c2-c454-4312-8dbc-0a6b5d23085a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.965986 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd49c2-c454-4312-8dbc-0a6b5d23085a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.966766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd49c2-c454-4312-8dbc-0a6b5d23085a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.968504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd49c2-c454-4312-8dbc-0a6b5d23085a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:21.979447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 783/1581] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:21.980355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd49c2-c454-4312-8dbc-0a6b5d23085a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:21.990712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd49c2-c454-4312-8dbc-0a6b5d23085a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:21.995374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f3033-8cd6-4227-b0e5-528ceb9ba316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:21.995958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f3033-8cd6-4227-b0e5-528ceb9ba316 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:21.996244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f3033-8cd6-4227-b0e5-528ceb9ba316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:21.996546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f3033-8cd6-4227-b0e5-528ceb9ba316 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:21.997165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f3033-8cd6-4227-b0e5-528ceb9ba316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:21.999061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f3033-8cd6-4227-b0e5-528ceb9ba316 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.017148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81d98-7005-43fb-936b-31c2239af8cc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.021565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 784/1582] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:22.022399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d3411-7a4c-4fd6-8c5c-fb4b08c51171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.022533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f3033-8cd6-4227-b0e5-528ceb9ba316 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.022992 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3411-7a4c-4fd6-8c5c-fb4b08c51171 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.023376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3411-7a4c-4fd6-8c5c-fb4b08c51171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.023651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3411-7a4c-4fd6-8c5c-fb4b08c51171 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.024307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d3411-7a4c-4fd6-8c5c-fb4b08c51171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.026294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d3411-7a4c-4fd6-8c5c-fb4b08c51171 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.032438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f3033-8cd6-4227-b0e5-528ceb9ba316 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.037868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849d90-6b91-4681-9aad-c30f933fcfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.038444 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849d90-6b91-4681-9aad-c30f933fcfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.038681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849d90-6b91-4681-9aad-c30f933fcfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.038954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849d90-6b91-4681-9aad-c30f933fcfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.039770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85849d90-6b91-4681-9aad-c30f933fcfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.041724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85849d90-6b91-4681-9aad-c30f933fcfe0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.048912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 799/1583] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:21 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:22.049728 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d3411-7a4c-4fd6-8c5c-fb4b08c51171 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.052945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 785/1584] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.053737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849d90-6b91-4681-9aad-c30f933fcfe0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.059823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d3411-7a4c-4fd6-8c5c-fb4b08c51171 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.063215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849d90-6b91-4681-9aad-c30f933fcfe0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.064573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1504-11af-4f87-954c-89c8244db9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.065178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1504-11af-4f87-954c-89c8244db9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.065464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1504-11af-4f87-954c-89c8244db9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.065746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1504-11af-4f87-954c-89c8244db9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.066582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d1504-11af-4f87-954c-89c8244db9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.068048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d1504-11af-4f87-954c-89c8244db9d4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.068290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c6d4-4c15-4091-be86-73cdf8a48025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.068938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c6d4-4c15-4091-be86-73cdf8a48025 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.069222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c6d4-4c15-4091-be86-73cdf8a48025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.069499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c6d4-4c15-4091-be86-73cdf8a48025 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.070157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4c6d4-4c15-4091-be86-73cdf8a48025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.072040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4c6d4-4c15-4091-be86-73cdf8a48025 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.078553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 800/1585] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.079153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1504-11af-4f87-954c-89c8244db9d4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.090228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1504-11af-4f87-954c-89c8244db9d4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.094495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 786/1586] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:22 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:22.094865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49036091-64b9-4258-8f45-676a482138fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.095478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49036091-64b9-4258-8f45-676a482138fe admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.095748 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49036091-64b9-4258-8f45-676a482138fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.096026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49036091-64b9-4258-8f45-676a482138fe admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.096681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49036091-64b9-4258-8f45-676a482138fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.099260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49036091-64b9-4258-8f45-676a482138fe admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.099400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c6d4-4c15-4091-be86-73cdf8a48025 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.122089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 801/1587] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:22 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:22.122908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49036091-64b9-4258-8f45-676a482138fe admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.135458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49036091-64b9-4258-8f45-676a482138fe admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.140103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08917aa9-d8e6-42db-b578-efe9ae559433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.140751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08917aa9-d8e6-42db-b578-efe9ae559433 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.141013 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08917aa9-d8e6-42db-b578-efe9ae559433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.141290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08917aa9-d8e6-42db-b578-efe9ae559433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.141932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08917aa9-d8e6-42db-b578-efe9ae559433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.143513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08917aa9-d8e6-42db-b578-efe9ae559433 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.154199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 802/1588] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.155026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08917aa9-d8e6-42db-b578-efe9ae559433 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.163062 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c6d4-4c15-4091-be86-73cdf8a48025 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.164882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08917aa9-d8e6-42db-b578-efe9ae559433 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.166866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff2a86-0627-42fc-a8ac-a12699291f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.167495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff2a86-0627-42fc-a8ac-a12699291f36 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.167777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff2a86-0627-42fc-a8ac-a12699291f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.168049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff2a86-0627-42fc-a8ac-a12699291f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.169954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314fdc7-8a98-4059-a146-3294a1272428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.170688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314fdc7-8a98-4059-a146-3294a1272428 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.171009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314fdc7-8a98-4059-a146-3294a1272428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.171357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314fdc7-8a98-4059-a146-3294a1272428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.172005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314fdc7-8a98-4059-a146-3294a1272428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.173923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314fdc7-8a98-4059-a146-3294a1272428 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.177560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff2a86-0627-42fc-a8ac-a12699291f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.179082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff2a86-0627-42fc-a8ac-a12699291f36 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.184791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 803/1589] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.185587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314fdc7-8a98-4059-a146-3294a1272428 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.188182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 787/1590] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:22.188983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff2a86-0627-42fc-a8ac-a12699291f36 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.198280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314fdc7-8a98-4059-a146-3294a1272428 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.199282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff2a86-0627-42fc-a8ac-a12699291f36 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.203777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746daf2f-4353-4745-96bf-9e6e7f5c414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.204276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49ad11-174c-42c1-a044-cb451cc8773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.204426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746daf2f-4353-4745-96bf-9e6e7f5c414d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.204678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746daf2f-4353-4745-96bf-9e6e7f5c414d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.205063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746daf2f-4353-4745-96bf-9e6e7f5c414d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.205366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49ad11-174c-42c1-a044-cb451cc8773c admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.205585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746daf2f-4353-4745-96bf-9e6e7f5c414d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.205829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49ad11-174c-42c1-a044-cb451cc8773c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.206251 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49ad11-174c-42c1-a044-cb451cc8773c admin admin] PATH_INFO: `/v3/projects/69b851966d024f7ca6f652a741d50c9b/users/f7eebe335f274e7aaabb0266583caf89/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.207960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746daf2f-4353-4745-96bf-9e6e7f5c414d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.218658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 804/1591] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.219477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746daf2f-4353-4745-96bf-9e6e7f5c414d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.225158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49ad11-174c-42c1-a044-cb451cc8773c admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b851966d024f7ca6f652a741d50c9b, user_id=f7eebe335f274e7aaabb0266583caf89, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.227854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49ad11-174c-42c1-a044-cb451cc8773c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.229555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746daf2f-4353-4745-96bf-9e6e7f5c414d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.234368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b027dc-a8eb-4a0b-a1be-77e0abc18bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.234953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b027dc-a8eb-4a0b-a1be-77e0abc18bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.235311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b027dc-a8eb-4a0b-a1be-77e0abc18bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.235582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b027dc-a8eb-4a0b-a1be-77e0abc18bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.236149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b027dc-a8eb-4a0b-a1be-77e0abc18bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.237871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b027dc-a8eb-4a0b-a1be-77e0abc18bcf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.242622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 788/1592] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:22 2022] PUT /identity/v3/projects/69b851966d024f7ca6f652a741d50c9b/users/f7eebe335f274e7aaabb0266583caf89/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:22.243604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49ad11-174c-42c1-a044-cb451cc8773c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.249095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 805/1593] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.249955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b027dc-a8eb-4a0b-a1be-77e0abc18bcf admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.259923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b027dc-a8eb-4a0b-a1be-77e0abc18bcf admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.307750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:22.320436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49ad11-174c-42c1-a044-cb451cc8773c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.325548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539588a2-3355-44ee-a7d6-b7ff4ad2760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.326234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539588a2-3355-44ee-a7d6-b7ff4ad2760c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.326587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539588a2-3355-44ee-a7d6-b7ff4ad2760c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.326687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acc516-8ddd-4bbd-b80f-510dddedd35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.327022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539588a2-3355-44ee-a7d6-b7ff4ad2760c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.327393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc516-8ddd-4bbd-b80f-510dddedd35e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.327742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc516-8ddd-4bbd-b80f-510dddedd35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.327845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539588a2-3355-44ee-a7d6-b7ff4ad2760c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.328150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc516-8ddd-4bbd-b80f-510dddedd35e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.328900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acc516-8ddd-4bbd-b80f-510dddedd35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.329698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539588a2-3355-44ee-a7d6-b7ff4ad2760c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.330791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acc516-8ddd-4bbd-b80f-510dddedd35e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.341347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 789/1594] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.341954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539588a2-3355-44ee-a7d6-b7ff4ad2760c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.343563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 806/1595] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.344651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acc516-8ddd-4bbd-b80f-510dddedd35e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.355422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539588a2-3355-44ee-a7d6-b7ff4ad2760c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.355992 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acc516-8ddd-4bbd-b80f-510dddedd35e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.360136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582ab23-5486-4f8c-b246-945b98250263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.360855 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ab23-5486-4f8c-b246-945b98250263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.360991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5ebe0-3a85-4c47-b6a1-682ae43ab2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.361141 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ab23-5486-4f8c-b246-945b98250263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.361422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ab23-5486-4f8c-b246-945b98250263 admin admin] PATH_INFO: `/v3/projects/4b10de4c4943478fb2fcebe41eedc1e0/users/2025e301202546f29a501233ba870a27/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.361552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5ebe0-3a85-4c47-b6a1-682ae43ab2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.361795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5ebe0-3a85-4c47-b6a1-682ae43ab2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.362077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5ebe0-3a85-4c47-b6a1-682ae43ab2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.362869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5ebe0-3a85-4c47-b6a1-682ae43ab2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.365170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5ebe0-3a85-4c47-b6a1-682ae43ab2c6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.376187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 807/1596] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.377186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5ebe0-3a85-4c47-b6a1-682ae43ab2c6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.382517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582ab23-5486-4f8c-b246-945b98250263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b10de4c4943478fb2fcebe41eedc1e0, user_id=2025e301202546f29a501233ba870a27, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.385407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582ab23-5486-4f8c-b246-945b98250263 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.388114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5ebe0-3a85-4c47-b6a1-682ae43ab2c6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.393391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbac6ed-5892-4eb7-a66d-a2fad38e67f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.394004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbac6ed-5892-4eb7-a66d-a2fad38e67f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.394437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbac6ed-5892-4eb7-a66d-a2fad38e67f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.394752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbac6ed-5892-4eb7-a66d-a2fad38e67f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.395419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbac6ed-5892-4eb7-a66d-a2fad38e67f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.397320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbac6ed-5892-4eb7-a66d-a2fad38e67f9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.403608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 790/1597] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:22 2022] PUT /identity/v3/projects/4b10de4c4943478fb2fcebe41eedc1e0/users/2025e301202546f29a501233ba870a27/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:22.415175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5746-3e2d-4689-aa62-279e7de2d974 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.415175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5746-3e2d-4689-aa62-279e7de2d974 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.415175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5746-3e2d-4689-aa62-279e7de2d974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.415684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 808/1598] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.415684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbac6ed-5892-4eb7-a66d-a2fad38e67f9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.425162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbac6ed-5892-4eb7-a66d-a2fad38e67f9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.431289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:22.437111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-560b5746-3e2d-4689-aa62-279e7de2d974 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:22.438674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-560b5746-3e2d-4689-aa62-279e7de2d974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:22.500354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8081b05-8d59-47e5-a1fc-bdb2d4622379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.501036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081b05-8d59-47e5-a1fc-bdb2d4622379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.501334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081b05-8d59-47e5-a1fc-bdb2d4622379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.501585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081b05-8d59-47e5-a1fc-bdb2d4622379 admin admin] PATH_INFO: `/v3/projects/2b1b2578001543d28542b927a0d5d456/users/c8704bf1437b466896a034420726a3e7/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.510195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 791/1599] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:22.511078 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b5746-3e2d-4689-aa62-279e7de2d974 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.521765 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b5746-3e2d-4689-aa62-279e7de2d974 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.524049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8081b05-8d59-47e5-a1fc-bdb2d4622379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1b2578001543d28542b927a0d5d456, user_id=c8704bf1437b466896a034420726a3e7, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.526895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8081b05-8d59-47e5-a1fc-bdb2d4622379 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.527253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b48834-3de7-4c08-bc76-bcf5dabe858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.527932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b48834-3de7-4c08-bc76-bcf5dabe858f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.528313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b48834-3de7-4c08-bc76-bcf5dabe858f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.528629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b48834-3de7-4c08-bc76-bcf5dabe858f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.529344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b48834-3de7-4c08-bc76-bcf5dabe858f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.531285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b48834-3de7-4c08-bc76-bcf5dabe858f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.542003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 809/1600] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:22 2022] PUT /identity/v3/projects/2b1b2578001543d28542b927a0d5d456/users/c8704bf1437b466896a034420726a3e7/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:22.546281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 792/1601] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.546281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b48834-3de7-4c08-bc76-bcf5dabe858f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.549438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8081b05-8d59-47e5-a1fc-bdb2d4622379 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.557691 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b48834-3de7-4c08-bc76-bcf5dabe858f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.621545 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bf87d-c31c-4454-ae6a-39bf208bae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.622400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bf87d-c31c-4454-ae6a-39bf208bae20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.622763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bf87d-c31c-4454-ae6a-39bf208bae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.623117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bf87d-c31c-4454-ae6a-39bf208bae20 admin admin] PATH_INFO: `/v3/projects/a00cd6862e1e426c845413515732a204/users/e01d1012d66b46b0806c9b77bfd161a7/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.628691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8081b05-8d59-47e5-a1fc-bdb2d4622379 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.633749 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8af54-c3c6-47e2-acf2-7803de531f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.634407 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8af54-c3c6-47e2-acf2-7803de531f2c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.634701 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8af54-c3c6-47e2-acf2-7803de531f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.634977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8af54-c3c6-47e2-acf2-7803de531f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.635655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8af54-c3c6-47e2-acf2-7803de531f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.637378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8af54-c3c6-47e2-acf2-7803de531f2c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.639600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bf87d-c31c-4454-ae6a-39bf208bae20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00cd6862e1e426c845413515732a204, user_id=e01d1012d66b46b0806c9b77bfd161a7, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.642441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bf87d-c31c-4454-ae6a-39bf208bae20 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.653557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 810/1602] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:22.653557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8af54-c3c6-47e2-acf2-7803de531f2c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.663608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 793/1603] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:22 2022] PUT /identity/v3/projects/a00cd6862e1e426c845413515732a204/users/e01d1012d66b46b0806c9b77bfd161a7/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:22.663608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee76337-5d82-417f-a5e7-d3ff33b474fc None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.663608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee76337-5d82-417f-a5e7-d3ff33b474fc None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.663608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee76337-5d82-417f-a5e7-d3ff33b474fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.671768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8af54-c3c6-47e2-acf2-7803de531f2c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.696855 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fee76337-5d82-417f-a5e7-d3ff33b474fc None None] MFA Rules not processed for user `2025e301202546f29a501233ba870a27`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:22.698085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fee76337-5d82-417f-a5e7-d3ff33b474fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:22.732688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:22.803598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 794/1604] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:22.803598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee76337-5d82-417f-a5e7-d3ff33b474fc None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.806393 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832c6e-612f-4e61-a02a-9a2b1720a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.807266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832c6e-612f-4e61-a02a-9a2b1720a5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.807715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832c6e-612f-4e61-a02a-9a2b1720a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.808237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832c6e-612f-4e61-a02a-9a2b1720a5c6 admin admin] PATH_INFO: `/v3/projects/e75e26d9147d4f1bbef5b4ccb2f2c509/users/4c1ede96ad444ec4891622798ee0ed90/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.832877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2832c6e-612f-4e61-a02a-9a2b1720a5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75e26d9147d4f1bbef5b4ccb2f2c509, user_id=4c1ede96ad444ec4891622798ee0ed90, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.836675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2832c6e-612f-4e61-a02a-9a2b1720a5c6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.852922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 811/1605] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:22 2022] PUT /identity/v3/projects/e75e26d9147d4f1bbef5b4ccb2f2c509/users/4c1ede96ad444ec4891622798ee0ed90/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:22.854325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832c6e-612f-4e61-a02a-9a2b1720a5c6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:22.870137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:22.871948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee76337-5d82-417f-a5e7-d3ff33b474fc None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.923064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed930e7-c832-44ce-9b12-520f121c8f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.923680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed930e7-c832-44ce-9b12-520f121c8f7c service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.923992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed930e7-c832-44ce-9b12-520f121c8f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.924265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed930e7-c832-44ce-9b12-520f121c8f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.934378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832c6e-612f-4e61-a02a-9a2b1720a5c6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:22.939108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19819525-34fc-44e3-9651-f57d382a14f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:22.939768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19819525-34fc-44e3-9651-f57d382a14f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.940052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19819525-34fc-44e3-9651-f57d382a14f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.940352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19819525-34fc-44e3-9651-f57d382a14f0 admin admin] PATH_INFO: `/v3/projects/ce7b1a726fa7452e936b6e9cb69c1e16/users/ab7d912b04864b1e87c9b8f3ef789f0c/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.954505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19819525-34fc-44e3-9651-f57d382a14f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7b1a726fa7452e936b6e9cb69c1e16, user_id=ab7d912b04864b1e87c9b8f3ef789f0c, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.957845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19819525-34fc-44e3-9651-f57d382a14f0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:22.972945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 812/1606] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:22 2022] PUT /identity/v3/projects/ce7b1a726fa7452e936b6e9cb69c1e16/users/ab7d912b04864b1e87c9b8f3ef789f0c/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:22.974198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ec0a-1092-45f6-9cfb-f5b2adb2c0b3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:22.974481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ec0a-1092-45f6-9cfb-f5b2adb2c0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:22.974754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ec0a-1092-45f6-9cfb-f5b2adb2c0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:22.997928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed930e7-c832-44ce-9b12-520f121c8f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:22.999376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed930e7-c832-44ce-9b12-520f121c8f7c service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:23.002489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-daa8ec0a-1092-45f6-9cfb-f5b2adb2c0b3 None None] MFA Rules not processed for user `c8704bf1437b466896a034420726a3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:23.004352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-daa8ec0a-1092-45f6-9cfb-f5b2adb2c0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:23.009659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 795/1607] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:23.010441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed930e7-c832-44ce-9b12-520f121c8f7c service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:23.020064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed930e7-c832-44ce-9b12-520f121c8f7c service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:23.059145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:23.085780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 813/1608] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:23.087378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b1c4b-66bf-471e-8aa2-798434ed0cd2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.087903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b1c4b-66bf-471e-8aa2-798434ed0cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.087903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b1c4b-66bf-471e-8aa2-798434ed0cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.097500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f355d5-a060-455b-a06e-2915df6ad0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:23.097745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f355d5-a060-455b-a06e-2915df6ad0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.098060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f355d5-a060-455b-a06e-2915df6ad0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.098407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f355d5-a060-455b-a06e-2915df6ad0a3 admin admin] PATH_INFO: `/v3/projects/656784114eee484a8c5235d85007245a/users/d256e317788d400a97a0035522fc4e9f/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.108795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-566b1c4b-66bf-471e-8aa2-798434ed0cd2 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:23.110011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-566b1c4b-66bf-471e-8aa2-798434ed0cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:23.117383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f355d5-a060-455b-a06e-2915df6ad0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656784114eee484a8c5235d85007245a, user_id=d256e317788d400a97a0035522fc4e9f, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:23.120199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 814/1609] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:23.120484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f355d5-a060-455b-a06e-2915df6ad0a3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:23.121671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b1c4b-66bf-471e-8aa2-798434ed0cd2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:23.133332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b1c4b-66bf-471e-8aa2-798434ed0cd2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:23.139244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b00a5-438a-43e4-b6e6-734bcdd49fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:23.140095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b00a5-438a-43e4-b6e6-734bcdd49fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.140518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b00a5-438a-43e4-b6e6-734bcdd49fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.141029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b00a5-438a-43e4-b6e6-734bcdd49fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.142160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b00a5-438a-43e4-b6e6-734bcdd49fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:23.145460 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b00a5-438a-43e4-b6e6-734bcdd49fb1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:23.148361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 796/1610] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:23 2022] PUT /identity/v3/projects/656784114eee484a8c5235d85007245a/users/d256e317788d400a97a0035522fc4e9f/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:23.149508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8dc36-a33a-4624-9f4c-064d8dc9b00a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.149777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8dc36-a33a-4624-9f4c-064d8dc9b00a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.150060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8dc36-a33a-4624-9f4c-064d8dc9b00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.181089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 815/1611] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:23 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:23.181478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-eba8dc36-a33a-4624-9f4c-064d8dc9b00a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:23.182703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8546a0e-f9f2-4bd0-b901-8ee990a665e8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.183096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8546a0e-f9f2-4bd0-b901-8ee990a665e8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.183476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8546a0e-f9f2-4bd0-b901-8ee990a665e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.183693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eba8dc36-a33a-4624-9f4c-064d8dc9b00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:23.215194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d8546a0e-f9f2-4bd0-b901-8ee990a665e8 None None] MFA Rules not processed for user `ab7d912b04864b1e87c9b8f3ef789f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:23.216868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d8546a0e-f9f2-4bd0-b901-8ee990a665e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:23.270833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 797/1612] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:23.273159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8dc36-a33a-4624-9f4c-064d8dc9b00a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:23.275707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eba8dc36-a33a-4624-9f4c-064d8dc9b00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:23.283553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:23.313214 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 816/1613] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:23.314533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e9ab2-7747-4a13-9ce4-d49b559dcc69 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.314824 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e9ab2-7747-4a13-9ce4-d49b559dcc69 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.315098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e9ab2-7747-4a13-9ce4-d49b559dcc69 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.318146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 817/1614] 10.222.0.83 () {54 vars in 962 bytes} [Wed Aug 31 01:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:08:23.319459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd491c69-3d86-4deb-8cef-c1a717437b1a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.319752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd491c69-3d86-4deb-8cef-c1a717437b1a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.320029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd491c69-3d86-4deb-8cef-c1a717437b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.350919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8dc36-a33a-4624-9f4c-064d8dc9b00a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:23.354793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77743f77-9a5a-49af-bded-eec3409550a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:23.355417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77743f77-9a5a-49af-bded-eec3409550a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.355753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77743f77-9a5a-49af-bded-eec3409550a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.356200 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77743f77-9a5a-49af-bded-eec3409550a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.356964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dd491c69-3d86-4deb-8cef-c1a717437b1a None None] MFA Rules not processed for user `d256e317788d400a97a0035522fc4e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:23.358441 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dd491c69-3d86-4deb-8cef-c1a717437b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:23.366263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77743f77-9a5a-49af-bded-eec3409550a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:23.368896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77743f77-9a5a-49af-bded-eec3409550a0 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:23.382088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 798/1615] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:23.382932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77743f77-9a5a-49af-bded-eec3409550a0 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:23.393202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77743f77-9a5a-49af-bded-eec3409550a0 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:23.399683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebb1bc-3e36-4d40-acc8-5df27a442f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:23.400306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebb1bc-3e36-4d40-acc8-5df27a442f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.400622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebb1bc-3e36-4d40-acc8-5df27a442f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.400899 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebb1bc-3e36-4d40-acc8-5df27a442f63 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.401703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebb1bc-3e36-4d40-acc8-5df27a442f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:23.403843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebb1bc-3e36-4d40-acc8-5df27a442f63 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:23.450819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 799/1616] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:23 2022] POST /identity/v3/users => generated 295 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:23.450819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebb1bc-3e36-4d40-acc8-5df27a442f63 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:23.459284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 818/1617] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:23.460905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59784c-c2b1-4f73-a8bd-8df66904476c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.461176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59784c-c2b1-4f73-a8bd-8df66904476c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.461464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59784c-c2b1-4f73-a8bd-8df66904476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.480159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebb1bc-3e36-4d40-acc8-5df27a442f63 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:23.484180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ba3d1-14ee-4811-a277-cc83f9dfcbc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:23.484848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ba3d1-14ee-4811-a277-cc83f9dfcbc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.485130 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ba3d1-14ee-4811-a277-cc83f9dfcbc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.485404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ba3d1-14ee-4811-a277-cc83f9dfcbc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.503153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ba3d1-14ee-4811-a277-cc83f9dfcbc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:23.513410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ba3d1-14ee-4811-a277-cc83f9dfcbc9 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:23.526722 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 800/1618] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:23.527857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12e2e0-48cb-4a30-8d20-0239e9e48411 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.528145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12e2e0-48cb-4a30-8d20-0239e9e48411 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.528448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12e2e0-48cb-4a30-8d20-0239e9e48411 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.529881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 801/1619] 10.222.0.83 () {54 vars in 962 bytes} [Wed Aug 31 01:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:08:23.530393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12e2e0-48cb-4a30-8d20-0239e9e48411 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:23.533558 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7e59784c-c2b1-4f73-a8bd-8df66904476c None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:23.536108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7e59784c-c2b1-4f73-a8bd-8df66904476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:23.558937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12e2e0-48cb-4a30-8d20-0239e9e48411 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:23.564464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b12288-8310-4be3-8f9c-e1b40b07e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:23.565085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12288-8310-4be3-8f9c-e1b40b07e33b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.566076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12288-8310-4be3-8f9c-e1b40b07e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.566076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12288-8310-4be3-8f9c-e1b40b07e33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.566537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b12288-8310-4be3-8f9c-e1b40b07e33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:23.568125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b12288-8310-4be3-8f9c-e1b40b07e33b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:23.584628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 802/1620] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:23.584628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b12288-8310-4be3-8f9c-e1b40b07e33b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:23.592897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b12288-8310-4be3-8f9c-e1b40b07e33b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:23.600367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c1990-1bb5-4d92-aad5-99de6be58e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:23.602084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1990-1bb5-4d92-aad5-99de6be58e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.602084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1990-1bb5-4d92-aad5-99de6be58e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.602084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1990-1bb5-4d92-aad5-99de6be58e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.602990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c1990-1bb5-4d92-aad5-99de6be58e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:23.605436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c1990-1bb5-4d92-aad5-99de6be58e07 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:23.623228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:23.646132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 803/1621] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:23 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:23.648028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e199a-ebb7-4e67-9431-a14f377b880b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.648471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e199a-ebb7-4e67-9431-a14f377b880b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.648855 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e199a-ebb7-4e67-9431-a14f377b880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.668857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 819/1622] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Aug 31 01:08:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:23.671749 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59784c-c2b1-4f73-a8bd-8df66904476c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:23.678583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4b1e199a-ebb7-4e67-9431-a14f377b880b None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:23.681477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4b1e199a-ebb7-4e67-9431-a14f377b880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:23.690752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59784c-c2b1-4f73-a8bd-8df66904476c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:23.770381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:23.786952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f0298-d3c1-4242-9ac9-333cc76d3fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:23.787604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f0298-d3c1-4242-9ac9-333cc76d3fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.787981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f0298-d3c1-4242-9ac9-333cc76d3fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.788793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f0298-d3c1-4242-9ac9-333cc76d3fa3 admin admin] PATH_INFO: `/v3/projects/784d1be52ba9499687e63a42fe154aae/users/94fdee5984db450086c4d0ba791a73b2/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.819129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 804/1623] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Aug 31 01:08:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:23.820568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f0298-d3c1-4242-9ac9-333cc76d3fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784d1be52ba9499687e63a42fe154aae, user_id=94fdee5984db450086c4d0ba791a73b2, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:23.820832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e199a-ebb7-4e67-9431-a14f377b880b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:23.824767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f0298-d3c1-4242-9ac9-333cc76d3fa3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:23.853790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e199a-ebb7-4e67-9431-a14f377b880b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:23.858550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 820/1624] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:23 2022] PUT /identity/v3/projects/784d1be52ba9499687e63a42fe154aae/users/94fdee5984db450086c4d0ba791a73b2/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:23.858951 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f0298-d3c1-4242-9ac9-333cc76d3fa3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:23.979509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254ce5a-ebcb-40a8-893f-37c4ea88704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:23.980098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254ce5a-ebcb-40a8-893f-37c4ea88704c admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:23.980406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254ce5a-ebcb-40a8-893f-37c4ea88704c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:23.980690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254ce5a-ebcb-40a8-893f-37c4ea88704c admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:23.981378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254ce5a-ebcb-40a8-893f-37c4ea88704c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:23.983324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254ce5a-ebcb-40a8-893f-37c4ea88704c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:24.012637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f0298-d3c1-4242-9ac9-333cc76d3fa3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:24.026813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e61ea-1d77-467e-9dbd-d9adfdc40085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:24.030544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 805/1625] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:23 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:24.031531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254ce5a-ebcb-40a8-893f-37c4ea88704c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:24.032510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e61ea-1d77-467e-9dbd-d9adfdc40085 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.032792 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e61ea-1d77-467e-9dbd-d9adfdc40085 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.033597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e61ea-1d77-467e-9dbd-d9adfdc40085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.059450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254ce5a-ebcb-40a8-893f-37c4ea88704c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:24.075184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aba177-7c88-47cf-b84f-44d10401abe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:24.076951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aba177-7c88-47cf-b84f-44d10401abe5 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.077145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aba177-7c88-47cf-b84f-44d10401abe5 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.077435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aba177-7c88-47cf-b84f-44d10401abe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.166859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e61ea-1d77-467e-9dbd-d9adfdc40085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:24.169576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e61ea-1d77-467e-9dbd-d9adfdc40085 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:24.185341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 821/1626] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:24.186351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e61ea-1d77-467e-9dbd-d9adfdc40085 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:24.197699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e61ea-1d77-467e-9dbd-d9adfdc40085 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:24.213007 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605db08-cdcc-4152-9253-ddbc04207281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:24.214372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aba177-7c88-47cf-b84f-44d10401abe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:24.215896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605db08-cdcc-4152-9253-ddbc04207281 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.215896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605db08-cdcc-4152-9253-ddbc04207281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.217338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aba177-7c88-47cf-b84f-44d10401abe5 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:24.217716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605db08-cdcc-4152-9253-ddbc04207281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.218381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605db08-cdcc-4152-9253-ddbc04207281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:24.223348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605db08-cdcc-4152-9253-ddbc04207281 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:24.240695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 806/1627] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:24.259417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aba177-7c88-47cf-b84f-44d10401abe5 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:24.260637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 822/1628] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:24.266134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605db08-cdcc-4152-9253-ddbc04207281 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:24.294570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aba177-7c88-47cf-b84f-44d10401abe5 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:24.298606 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605db08-cdcc-4152-9253-ddbc04207281 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:24.311410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c016502-53ff-43ff-a749-2fbc3a4e5e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:24.312044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c016502-53ff-43ff-a749-2fbc3a4e5e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.312338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c016502-53ff-43ff-a749-2fbc3a4e5e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.312638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c016502-53ff-43ff-a749-2fbc3a4e5e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.313294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c016502-53ff-43ff-a749-2fbc3a4e5e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:24.315669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c016502-53ff-43ff-a749-2fbc3a4e5e11 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:24.318230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4f242-6023-44ae-b520-aaa907cb784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:24.321010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f242-6023-44ae-b520-aaa907cb784c admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.323165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f242-6023-44ae-b520-aaa907cb784c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.323645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f242-6023-44ae-b520-aaa907cb784c admin admin] PATH_INFO: `/v3/projects/784d1be52ba9499687e63a42fe154aae/users/94fdee5984db450086c4d0ba791a73b2/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.330004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4f242-6023-44ae-b520-aaa907cb784c admin admin] RBAC: Authorizing `identity:create_grant(project_id=784d1be52ba9499687e63a42fe154aae, user_id=94fdee5984db450086c4d0ba791a73b2, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:24.340731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 807/1629] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:24.341622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4f242-6023-44ae-b520-aaa907cb784c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:24.344899 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c016502-53ff-43ff-a749-2fbc3a4e5e11 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:24.361896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:24.366116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c016502-53ff-43ff-a749-2fbc3a4e5e11 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:24.373744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 823/1630] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:24 2022] PUT /identity/v3/projects/784d1be52ba9499687e63a42fe154aae/users/94fdee5984db450086c4d0ba791a73b2/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:24.388759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605172b-1181-40b6-b494-6767c256943b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.389392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605172b-1181-40b6-b494-6767c256943b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.389885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605172b-1181-40b6-b494-6767c256943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.468501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1605172b-1181-40b6-b494-6767c256943b None None] MFA Rules not processed for user `94fdee5984db450086c4d0ba791a73b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:24.471008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1605172b-1181-40b6-b494-6767c256943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:24.513990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58375d4e-9b04-47d2-ba8b-47f6c768aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:24.516514 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58375d4e-9b04-47d2-ba8b-47f6c768aee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.516811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58375d4e-9b04-47d2-ba8b-47f6c768aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.517089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58375d4e-9b04-47d2-ba8b-47f6c768aee5 admin admin] PATH_INFO: `/v3/projects/930657e434754c61b700e6906bcf0efc/users/cf4f039d58aa48039be61ae85f0a2670/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.559094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:24.564014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58375d4e-9b04-47d2-ba8b-47f6c768aee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930657e434754c61b700e6906bcf0efc, user_id=cf4f039d58aa48039be61ae85f0a2670, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:24.573041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58375d4e-9b04-47d2-ba8b-47f6c768aee5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:24.609083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 808/1631] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:24 2022] PUT /identity/v3/projects/930657e434754c61b700e6906bcf0efc/users/cf4f039d58aa48039be61ae85f0a2670/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:08:24.610008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58375d4e-9b04-47d2-ba8b-47f6c768aee5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:24.617928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 824/1632] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:24.619512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605172b-1181-40b6-b494-6767c256943b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:24.721693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605172b-1181-40b6-b494-6767c256943b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:24.751512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58375d4e-9b04-47d2-ba8b-47f6c768aee5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:24.764411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28bc15-62dc-4923-a0d9-1338a1b49a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:24.766973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28bc15-62dc-4923-a0d9-1338a1b49a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.767408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28bc15-62dc-4923-a0d9-1338a1b49a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.767690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28bc15-62dc-4923-a0d9-1338a1b49a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.770432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28bc15-62dc-4923-a0d9-1338a1b49a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:24.774368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28bc15-62dc-4923-a0d9-1338a1b49a37 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:24.784360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc3acf-d58c-49bd-bffe-87ed8d6e5569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:24.785535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc3acf-d58c-49bd-bffe-87ed8d6e5569 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.785969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc3acf-d58c-49bd-bffe-87ed8d6e5569 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.786248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc3acf-d58c-49bd-bffe-87ed8d6e5569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.805412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 809/1633] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:24.806940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d4ad7-8668-4c08-bd88-ed457606e774 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.807338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d4ad7-8668-4c08-bd88-ed457606e774 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.807621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d4ad7-8668-4c08-bd88-ed457606e774 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.810702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 810/1634] 10.222.0.83 () {54 vars in 912 bytes} [Wed Aug 31 01:08:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:08:24.811531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d4ad7-8668-4c08-bd88-ed457606e774 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:24.830092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d4ad7-8668-4c08-bd88-ed457606e774 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:24.836420 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7f630-c428-4a1e-a12d-1e062bcf5304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:24.837228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f630-c428-4a1e-a12d-1e062bcf5304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.837522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f630-c428-4a1e-a12d-1e062bcf5304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.837809 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f630-c428-4a1e-a12d-1e062bcf5304 admin admin] PATH_INFO: `/v3/projects/930657e434754c61b700e6906bcf0efc/users/cf4f039d58aa48039be61ae85f0a2670/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.840129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7f630-c428-4a1e-a12d-1e062bcf5304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930657e434754c61b700e6906bcf0efc, user_id=cf4f039d58aa48039be61ae85f0a2670, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:24.842991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7f630-c428-4a1e-a12d-1e062bcf5304 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:24.856872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 811/1635] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:24 2022] PUT /identity/v3/projects/930657e434754c61b700e6906bcf0efc/users/cf4f039d58aa48039be61ae85f0a2670/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:24.868785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83425f90-83ef-410b-aa6f-3795afdb89da None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.869118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83425f90-83ef-410b-aa6f-3795afdb89da None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.869351 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83425f90-83ef-410b-aa6f-3795afdb89da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.875940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc3acf-d58c-49bd-bffe-87ed8d6e5569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:24.877588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc3acf-d58c-49bd-bffe-87ed8d6e5569 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:24.890854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 825/1636] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:24.892468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d044c-bf1b-4d01-a0e4-b7f814d85a40 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.892727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-83425f90-83ef-410b-aa6f-3795afdb89da None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:24.892843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d044c-bf1b-4d01-a0e4-b7f814d85a40 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.893020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d044c-bf1b-4d01-a0e4-b7f814d85a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:24.894147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-83425f90-83ef-410b-aa6f-3795afdb89da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:24.929825 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-879d044c-bf1b-4d01-a0e4-b7f814d85a40 None None] MFA Rules not processed for user `cf4f039d58aa48039be61ae85f0a2670`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:24.931692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-879d044c-bf1b-4d01-a0e4-b7f814d85a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:24.994609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 812/1637] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:08:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:24.996968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e28c8-4abc-4dac-bdb6-4d982a962864 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:24.997376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e28c8-4abc-4dac-bdb6-4d982a962864 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:24.997798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e28c8-4abc-4dac-bdb6-4d982a962864 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:25.009784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 813/1638] 10.222.0.83 () {54 vars in 912 bytes} [Wed Aug 31 01:08:24 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:08:25.011289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e28c8-4abc-4dac-bdb6-4d982a962864 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:25.017454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:25.022948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:25.086682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 826/1639] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:25.086682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929072f9-8ae5-4333-87a2-a175f4639ca9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:25.086682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929072f9-8ae5-4333-87a2-a175f4639ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:25.086682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929072f9-8ae5-4333-87a2-a175f4639ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:25.110382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-929072f9-8ae5-4333-87a2-a175f4639ca9 None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:25.111837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-929072f9-8ae5-4333-87a2-a175f4639ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:25.138643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 827/1640] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:08:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:25.177578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e28c8-4abc-4dac-bdb6-4d982a962864 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:25.182672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fe108-35a2-4df2-bb19-7ea9fafb79e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:25.183365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fe108-35a2-4df2-bb19-7ea9fafb79e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:25.183656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fe108-35a2-4df2-bb19-7ea9fafb79e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:25.184229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fe108-35a2-4df2-bb19-7ea9fafb79e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:25.203080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fe108-35a2-4df2-bb19-7ea9fafb79e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:25.206083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fe108-35a2-4df2-bb19-7ea9fafb79e3 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:25.220170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 814/1641] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:25.297239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929072f9-8ae5-4333-87a2-a175f4639ca9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:25.321501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929072f9-8ae5-4333-87a2-a175f4639ca9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:25.334422 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1c2cd-ae9f-4a46-84a7-f5c7af6c81d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:25.337779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1c2cd-ae9f-4a46-84a7-f5c7af6c81d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:25.338064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1c2cd-ae9f-4a46-84a7-f5c7af6c81d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:25.338338 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1c2cd-ae9f-4a46-84a7-f5c7af6c81d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:25.365040 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1c2cd-ae9f-4a46-84a7-f5c7af6c81d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:25.367719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1c2cd-ae9f-4a46-84a7-f5c7af6c81d1 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:25.393051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 828/1642] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:25.494467 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fe108-35a2-4df2-bb19-7ea9fafb79e3 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:25.587810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fe108-35a2-4df2-bb19-7ea9fafb79e3 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:25.587810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a63ddb-b68c-4489-b01f-42d915fae102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:25.587810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63ddb-b68c-4489-b01f-42d915fae102 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:25.587810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63ddb-b68c-4489-b01f-42d915fae102 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:25.588931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63ddb-b68c-4489-b01f-42d915fae102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:25.588931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a63ddb-b68c-4489-b01f-42d915fae102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:25.588931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a63ddb-b68c-4489-b01f-42d915fae102 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:25.620915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 815/1643] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:26.565022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1c2cd-ae9f-4a46-84a7-f5c7af6c81d1 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:26.580729 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1c2cd-ae9f-4a46-84a7-f5c7af6c81d1 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:26.591452 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78456cfc-9174-483d-ac65-6a263ce68940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:26.592838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456cfc-9174-483d-ac65-6a263ce68940 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:26.596380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456cfc-9174-483d-ac65-6a263ce68940 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:26.596847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456cfc-9174-483d-ac65-6a263ce68940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:26.760171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456cfc-9174-483d-ac65-6a263ce68940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:26.764431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456cfc-9174-483d-ac65-6a263ce68940 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:26.784089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 829/1644] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:27.369549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a63ddb-b68c-4489-b01f-42d915fae102 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:27.553849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a63ddb-b68c-4489-b01f-42d915fae102 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:27.567218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:27.568292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:27.568292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:27.571649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] PATH_INFO: `/v3/users/ab7d912b04864b1e87c9b8f3ef789f0c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:27.576258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7d912b04864b1e87c9b8f3ef789f0c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:27.577687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: WARNING py.warnings [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:08:27.577687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 01:08:27.577687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: Aug 31 01:08:27.579669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:27.772924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7d912b04864b1e87c9b8f3ef789f0c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:27.774663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7d912b04864b1e87c9b8f3ef789f0c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:27.799023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7d912b04864b1e87c9b8f3ef789f0c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:27.819139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7d912b04864b1e87c9b8f3ef789f0c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:27.883220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7d912b04864b1e87c9b8f3ef789f0c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:27.908342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 816/1645] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:27 2022] DELETE /identity/v3/users/ab7d912b04864b1e87c9b8f3ef789f0c => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:27.914816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3341-8807-44d8-99cd-4bed24bd1ffe None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:27.915294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3341-8807-44d8-99cd-4bed24bd1ffe None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:27.915561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3341-8807-44d8-99cd-4bed24bd1ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:27.961105 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c38d3341-8807-44d8-99cd-4bed24bd1ffe None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:27.963983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c38d3341-8807-44d8-99cd-4bed24bd1ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:28.140068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 830/1646] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:28.161732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:28.163447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:28.187838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:28.346110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59945751-0fca-41e0-bac7-e0ac5b4f3895 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:28.357116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72a490-8117-4d55-80dc-33e78d00ecff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:28.358269 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72a490-8117-4d55-80dc-33e78d00ecff service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:28.361064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72a490-8117-4d55-80dc-33e78d00ecff service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:28.361573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72a490-8117-4d55-80dc-33e78d00ecff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:28.387938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72a490-8117-4d55-80dc-33e78d00ecff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:28.393311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72a490-8117-4d55-80dc-33e78d00ecff service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:28.420789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 817/1647] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:28.960440 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3341-8807-44d8-99cd-4bed24bd1ffe None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:28.962087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c38d3341-8807-44d8-99cd-4bed24bd1ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:29.112185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:29.124553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3341-8807-44d8-99cd-4bed24bd1ffe None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:29.135050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7898212-1402-4513-aeb7-bb663d4a80c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:29.136904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7898212-1402-4513-aeb7-bb663d4a80c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:29.138343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7898212-1402-4513-aeb7-bb663d4a80c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:29.139477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7898212-1402-4513-aeb7-bb663d4a80c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:29.144938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f7898212-1402-4513-aeb7-bb663d4a80c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:29.403377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7898212-1402-4513-aeb7-bb663d4a80c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:29.404963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7898212-1402-4513-aeb7-bb663d4a80c0 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:29.441332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 831/1648] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:31.236357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72a490-8117-4d55-80dc-33e78d00ecff service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:31.239479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0e72a490-8117-4d55-80dc-33e78d00ecff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:31.263303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72a490-8117-4d55-80dc-33e78d00ecff service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:31.278651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:31.279528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:31.281007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:31.281007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] PATH_INFO: `/v3/projects/ce7b1a726fa7452e936b6e9cb69c1e16` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:31.281815 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7b1a726fa7452e936b6e9cb69c1e16)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:31.283944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:31.431357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7b1a726fa7452e936b6e9cb69c1e16', 'request_id': 'req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:31.439924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7b1a726fa7452e936b6e9cb69c1e16', 'request_id': 'req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:31.460933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7b1a726fa7452e936b6e9cb69c1e16', 'request_id': 'req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:31.486025 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] The token cache is being invalidate because project ce7b1a726fa7452e936b6e9cb69c1e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:08:31.486471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:31.487440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eeea6e0b-f8bf-4877-a4c0-3514924c8dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:31.489582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 818/1649] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:08:31 2022] DELETE /identity/v3/projects/ce7b1a726fa7452e936b6e9cb69c1e16 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:31.494465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc7ec-c6c7-48c0-a255-44aac99fd4da None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:31.495081 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc7ec-c6c7-48c0-a255-44aac99fd4da None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:31.495263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc7ec-c6c7-48c0-a255-44aac99fd4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:31.548347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-510bc7ec-c6c7-48c0-a255-44aac99fd4da None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:31.549682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-510bc7ec-c6c7-48c0-a255-44aac99fd4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:31.715252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 832/1650] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:31.723707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714f9db-a648-40f2-acc8-ab7ffe153376 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:31.724218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714f9db-a648-40f2-acc8-ab7ffe153376 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:31.724655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714f9db-a648-40f2-acc8-ab7ffe153376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:31.796603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5714f9db-a648-40f2-acc8-ab7ffe153376 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:31.797845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5714f9db-a648-40f2-acc8-ab7ffe153376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:31.828267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 819/1651] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:31.838603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bc7ec-c6c7-48c0-a255-44aac99fd4da None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:31.850529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bc7ec-c6c7-48c0-a255-44aac99fd4da None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:31.865568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306507ac-b62a-44fe-8e8c-65a22fb27dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:31.866050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306507ac-b62a-44fe-8e8c-65a22fb27dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:31.866337 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306507ac-b62a-44fe-8e8c-65a22fb27dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:31.866662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306507ac-b62a-44fe-8e8c-65a22fb27dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:31.867404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306507ac-b62a-44fe-8e8c-65a22fb27dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:31.868776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306507ac-b62a-44fe-8e8c-65a22fb27dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:31.872967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306507ac-b62a-44fe-8e8c-65a22fb27dc2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:31.938985 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714f9db-a648-40f2-acc8-ab7ffe153376 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:31.940490 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 833/1652] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:31.955387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714f9db-a648-40f2-acc8-ab7ffe153376 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:31.967903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229e52e-e630-4f13-8b11-7e2f5421e209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:31.968564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229e52e-e630-4f13-8b11-7e2f5421e209 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:31.968848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229e52e-e630-4f13-8b11-7e2f5421e209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:31.969123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229e52e-e630-4f13-8b11-7e2f5421e209 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:31.969763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229e52e-e630-4f13-8b11-7e2f5421e209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:31.973149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229e52e-e630-4f13-8b11-7e2f5421e209 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:32.048548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 820/1653] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:31 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:08:32.054303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306507ac-b62a-44fe-8e8c-65a22fb27dc2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:32.069225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306507ac-b62a-44fe-8e8c-65a22fb27dc2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:32.311716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc264a-6fa5-4e78-9d69-b7c2d81884d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:32.312537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc264a-6fa5-4e78-9d69-b7c2d81884d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:32.312829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc264a-6fa5-4e78-9d69-b7c2d81884d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:32.313117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc264a-6fa5-4e78-9d69-b7c2d81884d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:32.313800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc264a-6fa5-4e78-9d69-b7c2d81884d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:32.326912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc264a-6fa5-4e78-9d69-b7c2d81884d0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:32.389607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229e52e-e630-4f13-8b11-7e2f5421e209 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:32.416756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 834/1654] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:32 2022] POST /identity/v3/users => generated 302 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:32.418459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229e52e-e630-4f13-8b11-7e2f5421e209 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:32.444215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb2bb-7b4c-400f-9c99-e2f215e54b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:32.444850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb2bb-7b4c-400f-9c99-e2f215e54b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:32.445141 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb2bb-7b4c-400f-9c99-e2f215e54b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:32.445450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb2bb-7b4c-400f-9c99-e2f215e54b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:32.446087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb2bb-7b4c-400f-9c99-e2f215e54b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:32.449169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb2bb-7b4c-400f-9c99-e2f215e54b3b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:32.471694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 821/1655] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:32.475937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc264a-6fa5-4e78-9d69-b7c2d81884d0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:32.496822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc264a-6fa5-4e78-9d69-b7c2d81884d0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:32.512775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7be6e9-32a3-4517-9300-f23ca159bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:32.513625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7be6e9-32a3-4517-9300-f23ca159bffd admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:32.514250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7be6e9-32a3-4517-9300-f23ca159bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:32.515069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7be6e9-32a3-4517-9300-f23ca159bffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:32.515878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7be6e9-32a3-4517-9300-f23ca159bffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:32.518291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7be6e9-32a3-4517-9300-f23ca159bffd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:32.530908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb2bb-7b4c-400f-9c99-e2f215e54b3b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:32.532935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5e0cb2bb-7b4c-400f-9c99-e2f215e54b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:32.559329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb2bb-7b4c-400f-9c99-e2f215e54b3b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:32.588464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:32.588698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 835/1656] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:32.590185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7be6e9-32a3-4517-9300-f23ca159bffd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:32.590820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:32.591638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:32.593444 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] PATH_INFO: `/v3/users/c8704bf1437b466896a034420726a3e7` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:32.596900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8704bf1437b466896a034420726a3e7)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:32.605574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:32.611283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:32.633127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7be6e9-32a3-4517-9300-f23ca159bffd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:32.651371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a0936-3efe-49de-9679-9b5f8bf94d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:32.652056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a0936-3efe-49de-9679-9b5f8bf94d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:32.652408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a0936-3efe-49de-9679-9b5f8bf94d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:32.652681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a0936-3efe-49de-9679-9b5f8bf94d46 admin admin] PATH_INFO: `/v3/projects/914d718d76514bd78cfea50540b8ad60/users/f23d4247861a44ffa3186b7144d4bd64/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:32.701092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a0936-3efe-49de-9679-9b5f8bf94d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914d718d76514bd78cfea50540b8ad60, user_id=f23d4247861a44ffa3186b7144d4bd64, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:32.704499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a0936-3efe-49de-9679-9b5f8bf94d46 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:32.765122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 836/1657] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:32 2022] PUT /identity/v3/projects/914d718d76514bd78cfea50540b8ad60/users/f23d4247861a44ffa3186b7144d4bd64/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:32.768049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71bc8-40fb-453b-8c6c-79cb7b4774c5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:32.768503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8704bf1437b466896a034420726a3e7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:32.769515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71bc8-40fb-453b-8c6c-79cb7b4774c5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:32.769963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71bc8-40fb-453b-8c6c-79cb7b4774c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:32.770410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8704bf1437b466896a034420726a3e7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:32.784029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:32.805781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8704bf1437b466896a034420726a3e7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:32.824430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8704bf1437b466896a034420726a3e7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:32.859054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-efd79f66-6023-480b-a230-df4ad3cea2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8704bf1437b466896a034420726a3e7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:32.865144 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-19a71bc8-40fb-453b-8c6c-79cb7b4774c5 None None] MFA Rules not processed for user `f23d4247861a44ffa3186b7144d4bd64`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:32.869246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-19a71bc8-40fb-453b-8c6c-79cb7b4774c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:32.883334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 822/1658] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:32 2022] DELETE /identity/v3/users/c8704bf1437b466896a034420726a3e7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:32.886940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2b0f3-a547-4c91-a024-0688784c1d1b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:32.889371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2b0f3-a547-4c91-a024-0688784c1d1b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:32.889669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2b0f3-a547-4c91-a024-0688784c1d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:32.997729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7cf2b0f3-a547-4c91-a024-0688784c1d1b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:33.000631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7cf2b0f3-a547-4c91-a024-0688784c1d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:33.170120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 837/1659] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:33.172435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a71bc8-40fb-453b-8c6c-79cb7b4774c5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:33.177309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-19a71bc8-40fb-453b-8c6c-79cb7b4774c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:33.240246 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 823/1660] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:33.365127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a71bc8-40fb-453b-8c6c-79cb7b4774c5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:33.378068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44022e4-d50c-40d8-a07c-49c806196f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:33.383137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44022e4-d50c-40d8-a07c-49c806196f7f admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:33.385210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44022e4-d50c-40d8-a07c-49c806196f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:33.385654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44022e4-d50c-40d8-a07c-49c806196f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:33.386443 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44022e4-d50c-40d8-a07c-49c806196f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:33.388540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44022e4-d50c-40d8-a07c-49c806196f7f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:33.471336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 838/1661] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:33 2022] POST /identity/v3/projects => generated 405 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:33.477218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2b0f3-a547-4c91-a024-0688784c1d1b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:33.498920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2b0f3-a547-4c91-a024-0688784c1d1b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:33.605275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44022e4-d50c-40d8-a07c-49c806196f7f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:33.607850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c44022e4-d50c-40d8-a07c-49c806196f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:33.722383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d593-f750-400a-99e2-07e403735514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:33.725058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d593-f750-400a-99e2-07e403735514 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:33.725722 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d593-f750-400a-99e2-07e403735514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:33.726266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d593-f750-400a-99e2-07e403735514 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:33.727187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77d593-f750-400a-99e2-07e403735514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:33.729595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77d593-f750-400a-99e2-07e403735514 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:33.798416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 824/1662] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:33 2022] POST /identity/v3/users => generated 309 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:33.799629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d593-f750-400a-99e2-07e403735514 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:33.847528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d593-f750-400a-99e2-07e403735514 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:33.880559 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba003dbe-7ed7-4719-a19c-9971fb6303bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:33.880781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44022e4-d50c-40d8-a07c-49c806196f7f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:33.881469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba003dbe-7ed7-4719-a19c-9971fb6303bd admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:33.881777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba003dbe-7ed7-4719-a19c-9971fb6303bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:33.882314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba003dbe-7ed7-4719-a19c-9971fb6303bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:33.883216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba003dbe-7ed7-4719-a19c-9971fb6303bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:33.885505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba003dbe-7ed7-4719-a19c-9971fb6303bd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:33.885698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01062-ab8c-49f9-97fe-d9b2d0527e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:33.886362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01062-ab8c-49f9-97fe-d9b2d0527e8a service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:33.886644 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01062-ab8c-49f9-97fe-d9b2d0527e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:33.886917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01062-ab8c-49f9-97fe-d9b2d0527e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:33.901214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 825/1663] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:33.905417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba003dbe-7ed7-4719-a19c-9971fb6303bd admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:33.920946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:33.922140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba003dbe-7ed7-4719-a19c-9971fb6303bd admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:33.929695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe01062-ab8c-49f9-97fe-d9b2d0527e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:33.936767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e2503-e0a1-4fbf-977f-9ee0a13bdbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:33.938155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe01062-ab8c-49f9-97fe-d9b2d0527e8a service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:33.938984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e2503-e0a1-4fbf-977f-9ee0a13bdbfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:33.940047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e2503-e0a1-4fbf-977f-9ee0a13bdbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:33.940555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e2503-e0a1-4fbf-977f-9ee0a13bdbfa admin admin] PATH_INFO: `/v3/projects/09ba19caf1c04c928e195b7a04ece3a6/users/5892d7bc3b3c4dc19a398a72f2c0700d/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:33.976779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 839/1664] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:08:33.997422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e2503-e0a1-4fbf-977f-9ee0a13bdbfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ba19caf1c04c928e195b7a04ece3a6, user_id=5892d7bc3b3c4dc19a398a72f2c0700d, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:34.005476 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e2503-e0a1-4fbf-977f-9ee0a13bdbfa admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:34.048408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 826/1665] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:33 2022] PUT /identity/v3/projects/09ba19caf1c04c928e195b7a04ece3a6/users/5892d7bc3b3c4dc19a398a72f2c0700d/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:34.051736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01062-ab8c-49f9-97fe-d9b2d0527e8a service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:34.072534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01062-ab8c-49f9-97fe-d9b2d0527e8a service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:34.222856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e058ac0-ce4f-4420-825e-f605d68dfb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:34.223485 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e058ac0-ce4f-4420-825e-f605d68dfb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:34.223786 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e058ac0-ce4f-4420-825e-f605d68dfb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:34.224027 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e058ac0-ce4f-4420-825e-f605d68dfb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:34.224722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e058ac0-ce4f-4420-825e-f605d68dfb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:34.226294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e058ac0-ce4f-4420-825e-f605d68dfb33 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:34.263795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 840/1666] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:34.263952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e2503-e0a1-4fbf-977f-9ee0a13bdbfa admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:34.274887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e2503-e0a1-4fbf-977f-9ee0a13bdbfa admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:34.279745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b6c78-1f08-4e6d-8001-2c2c39b8f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:34.280649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b6c78-1f08-4e6d-8001-2c2c39b8f83f admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:34.280934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b6c78-1f08-4e6d-8001-2c2c39b8f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:34.281213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b6c78-1f08-4e6d-8001-2c2c39b8f83f admin admin] PATH_INFO: `/v3/projects/09ba19caf1c04c928e195b7a04ece3a6/users/5892d7bc3b3c4dc19a398a72f2c0700d/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:34.284204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b6c78-1f08-4e6d-8001-2c2c39b8f83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ba19caf1c04c928e195b7a04ece3a6, user_id=5892d7bc3b3c4dc19a398a72f2c0700d, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:34.286864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b6c78-1f08-4e6d-8001-2c2c39b8f83f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:34.323388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 827/1667] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:34 2022] PUT /identity/v3/projects/09ba19caf1c04c928e195b7a04ece3a6/users/5892d7bc3b3c4dc19a398a72f2c0700d/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:08:34.334451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b890c2-9825-4c31-8223-0e0f34de9dec None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:34.334756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b890c2-9825-4c31-8223-0e0f34de9dec None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:34.335012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b890c2-9825-4c31-8223-0e0f34de9dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:34.429272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f4b890c2-9825-4c31-8223-0e0f34de9dec None None] MFA Rules not processed for user `5892d7bc3b3c4dc19a398a72f2c0700d`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:34.430549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f4b890c2-9825-4c31-8223-0e0f34de9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:34.705721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 841/1668] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:34 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:34.744931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b6c78-1f08-4e6d-8001-2c2c39b8f83f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:34.750445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b94b6c78-1f08-4e6d-8001-2c2c39b8f83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:34.806136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:34.932016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b6c78-1f08-4e6d-8001-2c2c39b8f83f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:34.949215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a07bc5-3ee5-44a7-bf61-599a79594e2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:34.951631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07bc5-3ee5-44a7-bf61-599a79594e2b service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:34.951992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07bc5-3ee5-44a7-bf61-599a79594e2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:34.952361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07bc5-3ee5-44a7-bf61-599a79594e2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:34.965043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e19fa-32a6-4f4c-b951-e7ca87bd540c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:34.965043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e19fa-32a6-4f4c-b951-e7ca87bd540c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:34.965304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e19fa-32a6-4f4c-b951-e7ca87bd540c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:34.990795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a07bc5-3ee5-44a7-bf61-599a79594e2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:34.995934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a07bc5-3ee5-44a7-bf61-599a79594e2b service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:35.023704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-559e19fa-32a6-4f4c-b951-e7ca87bd540c None None] MFA Rules not processed for user `f7eebe335f274e7aaabb0266583caf89`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:35.026509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-559e19fa-32a6-4f4c-b951-e7ca87bd540c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:35.032886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 828/1669] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:34 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:35.170253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 842/1670] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:35.177372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a07bc5-3ee5-44a7-bf61-599a79594e2b service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:35.179534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-12a07bc5-3ee5-44a7-bf61-599a79594e2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:35.271158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e19fa-32a6-4f4c-b951-e7ca87bd540c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:35.282170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:35.323956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a07bc5-3ee5-44a7-bf61-599a79594e2b service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:35.331294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fa632-54a5-4f81-84bb-2c347ae6d63e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:35.332662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fa632-54a5-4f81-84bb-2c347ae6d63e service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:35.333296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fa632-54a5-4f81-84bb-2c347ae6d63e service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:35.333830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fa632-54a5-4f81-84bb-2c347ae6d63e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:35.361391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fa632-54a5-4f81-84bb-2c347ae6d63e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:35.367536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fa632-54a5-4f81-84bb-2c347ae6d63e service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:35.400595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 829/1671] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:35.416896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e19fa-32a6-4f4c-b951-e7ca87bd540c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:35.446158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:35.446359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252033f-9712-4ef9-8ece-536e462f23af None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:35.446456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:35.446561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252033f-9712-4ef9-8ece-536e462f23af None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:35.446643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:35.446722 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252033f-9712-4ef9-8ece-536e462f23af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:35.446800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] PATH_INFO: `/v3/users/f23d4247861a44ffa3186b7144d4bd64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:35.450266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23d4247861a44ffa3186b7144d4bd64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:35.452290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:35.500238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1252033f-9712-4ef9-8ece-536e462f23af None None] MFA Rules not processed for user `4c1ede96ad444ec4891622798ee0ed90`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:35.506285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1252033f-9712-4ef9-8ece-536e462f23af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:35.560461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23d4247861a44ffa3186b7144d4bd64'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:35.564131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23d4247861a44ffa3186b7144d4bd64'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:35.590138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23d4247861a44ffa3186b7144d4bd64'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:35.608502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23d4247861a44ffa3186b7144d4bd64'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:35.634256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23d4247861a44ffa3186b7144d4bd64'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:35.657907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 843/1672] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:35 2022] DELETE /identity/v3/users/f23d4247861a44ffa3186b7144d4bd64 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:08:35.658838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:35.664192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:35.685527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 830/1673] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:08:35.686926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d913c-e42f-4161-9185-e64e6f7e6bf9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:35.687712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d913c-e42f-4161-9185-e64e6f7e6bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:35.688061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d913c-e42f-4161-9185-e64e6f7e6bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:35.750111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c27d913c-e42f-4161-9185-e64e6f7e6bf9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:35.768365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c27d913c-e42f-4161-9185-e64e6f7e6bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:35.771325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d4416-924f-4387-9de3-6f97cc4f93ce admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:35.794818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:35.795475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:35.795766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:35.796051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] PATH_INFO: `/v3/projects/2b1b2578001543d28542b927a0d5d456` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:35.798639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1b2578001543d28542b927a0d5d456)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:35.799692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 01:08:35.799692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 01:08:35.799692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: Aug 31 01:08:35.803038 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 831/1674] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:35.805071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:35.806892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c6da-b6f7-4413-9413-1d8fb1ef3709 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:35.822677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c6da-b6f7-4413-9413-1d8fb1ef3709 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:35.823988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c6da-b6f7-4413-9413-1d8fb1ef3709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:35.889549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:35.932240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d0f1c6da-b6f7-4413-9413-1d8fb1ef3709 None None] MFA Rules not processed for user `4c1ede96ad444ec4891622798ee0ed90`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:35.933506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d0f1c6da-b6f7-4413-9413-1d8fb1ef3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:35.985935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:35.995826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1b2578001543d28542b927a0d5d456', 'request_id': 'req-56d4aa25-c259-4787-b765-017e9243046a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:36.046264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1b2578001543d28542b927a0d5d456', 'request_id': 'req-56d4aa25-c259-4787-b765-017e9243046a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:36.068021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1b2578001543d28542b927a0d5d456', 'request_id': 'req-56d4aa25-c259-4787-b765-017e9243046a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:36.083133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 832/1675] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:36.084886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c6da-b6f7-4413-9413-1d8fb1ef3709 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:36.086767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d0f1c6da-b6f7-4413-9413-1d8fb1ef3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:36.164912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] The token cache is being invalidate because project 2b1b2578001543d28542b927a0d5d456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:08:36.165213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:36.165892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:36.173536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 844/1676] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:08:35 2022] DELETE /identity/v3/projects/2b1b2578001543d28542b927a0d5d456 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:36.173536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:36.177865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:36.319448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c6da-b6f7-4413-9413-1d8fb1ef3709 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:36.329387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a34228-90f2-44f3-b990-f4d2f8fdf821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:36.330448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34228-90f2-44f3-b990-f4d2f8fdf821 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:36.331014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34228-90f2-44f3-b990-f4d2f8fdf821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:36.332581 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34228-90f2-44f3-b990-f4d2f8fdf821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:36.337830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-28a34228-90f2-44f3-b990-f4d2f8fdf821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:36.508348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4aa25-c259-4787-b765-017e9243046a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:36.529967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfb220-94cd-4d38-a0b9-555dda859844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:36.533552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb220-94cd-4d38-a0b9-555dda859844 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:36.533886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb220-94cd-4d38-a0b9-555dda859844 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:36.535658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb220-94cd-4d38-a0b9-555dda859844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:36.543035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f6dfb220-94cd-4d38-a0b9-555dda859844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:36.577696 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a34228-90f2-44f3-b990-f4d2f8fdf821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:36.590729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a34228-90f2-44f3-b990-f4d2f8fdf821 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:36.597793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfb220-94cd-4d38-a0b9-555dda859844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:36.601114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfb220-94cd-4d38-a0b9-555dda859844 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:36.623457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 833/1677] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:36.627816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7d3fd-6d56-4b25-ac94-c31449872f86 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:36.628442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7d3fd-6d56-4b25-ac94-c31449872f86 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:36.628570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7d3fd-6d56-4b25-ac94-c31449872f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:36.666326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 845/1678] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:36.718983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4bb7d3fd-6d56-4b25-ac94-c31449872f86 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:36.720215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4bb7d3fd-6d56-4b25-ac94-c31449872f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:36.756032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 834/1679] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:36.761501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd85eb5-0f51-4363-876f-99a71fe0ea46 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:36.761792 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd85eb5-0f51-4363-876f-99a71fe0ea46 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:36.762073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd85eb5-0f51-4363-876f-99a71fe0ea46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:36.827713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6dd85eb5-0f51-4363-876f-99a71fe0ea46 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:36.833805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6dd85eb5-0f51-4363-876f-99a71fe0ea46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:36.877474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 846/1680] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:36.880243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7d3fd-6d56-4b25-ac94-c31449872f86 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:36.932512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7d3fd-6d56-4b25-ac94-c31449872f86 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:36.960564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96053b79-8541-4224-be73-298c5d172eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:36.964472 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96053b79-8541-4224-be73-298c5d172eab admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:36.964770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96053b79-8541-4224-be73-298c5d172eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:36.965048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96053b79-8541-4224-be73-298c5d172eab admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:36.969119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96053b79-8541-4224-be73-298c5d172eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:36.972189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96053b79-8541-4224-be73-298c5d172eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:36.993317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96053b79-8541-4224-be73-298c5d172eab admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:37.047997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 835/1681] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:37.054148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd85eb5-0f51-4363-876f-99a71fe0ea46 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:37.083464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd85eb5-0f51-4363-876f-99a71fe0ea46 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:37.108968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949d5d-a891-4167-a901-1364e68dcd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:37.109969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949d5d-a891-4167-a901-1364e68dcd14 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:37.110574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949d5d-a891-4167-a901-1364e68dcd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:37.113284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949d5d-a891-4167-a901-1364e68dcd14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:37.116264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c949d5d-a891-4167-a901-1364e68dcd14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:37.120952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c949d5d-a891-4167-a901-1364e68dcd14 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:37.214678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 847/1682] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:37 2022] POST /identity/v3/projects => generated 399 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:37.218564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96053b79-8541-4224-be73-298c5d172eab admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:37.232165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96053b79-8541-4224-be73-298c5d172eab admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:37.404494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:37.417049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618af07-af2d-46b3-aec6-4768c6963a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:37.417692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618af07-af2d-46b3-aec6-4768c6963a6b admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:37.417978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618af07-af2d-46b3-aec6-4768c6963a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:37.418255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618af07-af2d-46b3-aec6-4768c6963a6b admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:37.418920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618af07-af2d-46b3-aec6-4768c6963a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:37.434706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618af07-af2d-46b3-aec6-4768c6963a6b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:37.436089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949d5d-a891-4167-a901-1364e68dcd14 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:37.438817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8c949d5d-a891-4167-a901-1364e68dcd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:37.461448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949d5d-a891-4167-a901-1364e68dcd14 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:37.487571 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:37.491788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:37.493057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:37.493511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] PATH_INFO: `/v3/users/82e631d78c544a9f926836c58423f39b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:37.498565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e631d78c544a9f926836c58423f39b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:37.499407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 836/1683] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:37 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:08:37.501093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618af07-af2d-46b3-aec6-4768c6963a6b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:37.502375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:37.526649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618af07-af2d-46b3-aec6-4768c6963a6b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:37.541624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ac8a-17e7-4a61-8a60-7c4f28abad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:37.544199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ac8a-17e7-4a61-8a60-7c4f28abad4a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:37.545159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ac8a-17e7-4a61-8a60-7c4f28abad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:37.546222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ac8a-17e7-4a61-8a60-7c4f28abad4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:37.548590 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9ac8a-17e7-4a61-8a60-7c4f28abad4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:37.552753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9ac8a-17e7-4a61-8a60-7c4f28abad4a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:37.586764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 837/1684] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:37.594865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ac8a-17e7-4a61-8a60-7c4f28abad4a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:37.612816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e631d78c544a9f926836c58423f39b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:37.613943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e631d78c544a9f926836c58423f39b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:37.623513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ac8a-17e7-4a61-8a60-7c4f28abad4a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:37.635460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b6d36-3689-4f84-ac9b-7c3a04d391a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:37.637431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b6d36-3689-4f84-ac9b-7c3a04d391a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:37.638523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b6d36-3689-4f84-ac9b-7c3a04d391a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:37.638628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e631d78c544a9f926836c58423f39b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:37.639823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b6d36-3689-4f84-ac9b-7c3a04d391a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:37.642343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b6d36-3689-4f84-ac9b-7c3a04d391a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:37.646276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b6d36-3689-4f84-ac9b-7c3a04d391a6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:37.667012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:37.672082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e631d78c544a9f926836c58423f39b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:37.681684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 838/1685] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:37.686473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b6d36-3689-4f84-ac9b-7c3a04d391a6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:37.690361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b572cda0-70aa-44df-ba77-87cdcdcbb54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e631d78c544a9f926836c58423f39b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:37.711551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 848/1686] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:37 2022] DELETE /identity/v3/users/82e631d78c544a9f926836c58423f39b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:37.723341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800c7b-dd36-43c5-8dc3-5496f9f44735 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:37.724127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800c7b-dd36-43c5-8dc3-5496f9f44735 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:37.724661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800c7b-dd36-43c5-8dc3-5496f9f44735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:37.729798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b6d36-3689-4f84-ac9b-7c3a04d391a6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:37.763175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-93800c7b-dd36-43c5-8dc3-5496f9f44735 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:37.764453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-93800c7b-dd36-43c5-8dc3-5496f9f44735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:37.882724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6a6d4-0832-4b9c-84ab-9c3a9027a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:37.883516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6a6d4-0832-4b9c-84ab-9c3a9027a035 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:37.884607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6a6d4-0832-4b9c-84ab-9c3a9027a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:37.885371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6a6d4-0832-4b9c-84ab-9c3a9027a035 admin admin] PATH_INFO: `/v3/projects/bbcd17269b2848ad8ff87dc3e13c688f/users/f1de267eb8ba419f9370756f45c585dd/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:37.900974 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 849/1687] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:37.910201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6a6d4-0832-4b9c-84ab-9c3a9027a035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcd17269b2848ad8ff87dc3e13c688f, user_id=f1de267eb8ba419f9370756f45c585dd, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:37.914251 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6a6d4-0832-4b9c-84ab-9c3a9027a035 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:37.944412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 839/1688] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:37 2022] PUT /identity/v3/projects/bbcd17269b2848ad8ff87dc3e13c688f/users/f1de267eb8ba419f9370756f45c585dd/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:37.946647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cd5ca-edf3-4058-abd5-249246756c2c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:37.946997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cd5ca-edf3-4058-abd5-249246756c2c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:37.947345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cd5ca-edf3-4058-abd5-249246756c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:37.994614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6a6d4-0832-4b9c-84ab-9c3a9027a035 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:37.999091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-64f6a6d4-0832-4b9c-84ab-9c3a9027a035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:38.002029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9f7cd5ca-edf3-4058-abd5-249246756c2c None None] MFA Rules not processed for user `f1de267eb8ba419f9370756f45c585dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:38.004279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9f7cd5ca-edf3-4058-abd5-249246756c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:38.165387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6a6d4-0832-4b9c-84ab-9c3a9027a035 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:38.184897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526434b6-470d-448f-a35a-38341f3dcff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:38.185557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526434b6-470d-448f-a35a-38341f3dcff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:38.185845 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526434b6-470d-448f-a35a-38341f3dcff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:38.186127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526434b6-470d-448f-a35a-38341f3dcff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:38.192761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 850/1689] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:38.194339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cd5ca-edf3-4058-abd5-249246756c2c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:38.195875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9f7cd5ca-edf3-4058-abd5-249246756c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:38.428107 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526434b6-470d-448f-a35a-38341f3dcff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:38.429859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526434b6-470d-448f-a35a-38341f3dcff1 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:38.447189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cd5ca-edf3-4058-abd5-249246756c2c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:38.447806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:38.474743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577739c-f585-4d14-ba5e-a29a96783281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:38.477367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577739c-f585-4d14-ba5e-a29a96783281 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:38.477367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577739c-f585-4d14-ba5e-a29a96783281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:38.488997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 840/1690] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:38.490020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577739c-f585-4d14-ba5e-a29a96783281 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:38.490981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577739c-f585-4d14-ba5e-a29a96783281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:38.492150 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15efc17-381b-417e-b5f7-44604620e707 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:38.494173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15efc17-381b-417e-b5f7-44604620e707 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:38.495348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15efc17-381b-417e-b5f7-44604620e707 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:38.497985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577739c-f585-4d14-ba5e-a29a96783281 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:38.500640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 841/1691] 10.222.0.83 () {54 vars in 912 bytes} [Wed Aug 31 01:08:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:08:38.502449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e68b77-0516-41ab-b7c9-806523ca5851 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:38.502964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e68b77-0516-41ab-b7c9-806523ca5851 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:38.503825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e68b77-0516-41ab-b7c9-806523ca5851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:38.606845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:38.623787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 851/1692] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:38 2022] POST /identity/v3/projects => generated 401 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:38.627670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577739c-f585-4d14-ba5e-a29a96783281 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:38.641457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-32e68b77-0516-41ab-b7c9-806523ca5851 None None] MFA Rules not processed for user `f6c13711596647178ad3f93865eca187`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:38.643144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-32e68b77-0516-41ab-b7c9-806523ca5851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:38.805880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 842/1693] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:08:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:38.838602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577739c-f585-4d14-ba5e-a29a96783281 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:38.845932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6154e-88b4-41f9-aa4e-3ebffabb8d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:38.846581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6154e-88b4-41f9-aa4e-3ebffabb8d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:38.847404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6154e-88b4-41f9-aa4e-3ebffabb8d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:38.847691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6154e-88b4-41f9-aa4e-3ebffabb8d9c admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:38.848352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6154e-88b4-41f9-aa4e-3ebffabb8d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:38.851766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6154e-88b4-41f9-aa4e-3ebffabb8d9c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:38.867701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e68b77-0516-41ab-b7c9-806523ca5851 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:38.869706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-32e68b77-0516-41ab-b7c9-806523ca5851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:38.891190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e68b77-0516-41ab-b7c9-806523ca5851 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:38.904859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 852/1694] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:38 2022] POST /identity/v3/users => generated 307 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:38.905775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7e7e-6aa7-4da6-8a43-a08e2534b307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:38.907223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7e7e-6aa7-4da6-8a43-a08e2534b307 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:38.907718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7e7e-6aa7-4da6-8a43-a08e2534b307 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:38.907998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7e7e-6aa7-4da6-8a43-a08e2534b307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:38.909256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6154e-88b4-41f9-aa4e-3ebffabb8d9c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:38.929521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab7e7e-6aa7-4da6-8a43-a08e2534b307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:38.938779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6154e-88b4-41f9-aa4e-3ebffabb8d9c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:38.940767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab7e7e-6aa7-4da6-8a43-a08e2534b307 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:38.954367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48337d98-adfe-4d8e-8bd6-4bfdae81c2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:38.955001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48337d98-adfe-4d8e-8bd6-4bfdae81c2ac admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:38.955290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48337d98-adfe-4d8e-8bd6-4bfdae81c2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:38.955631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48337d98-adfe-4d8e-8bd6-4bfdae81c2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:38.956493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48337d98-adfe-4d8e-8bd6-4bfdae81c2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:38.958059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 843/1695] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:38.958973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7e7e-6aa7-4da6-8a43-a08e2534b307 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:38.960442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48337d98-adfe-4d8e-8bd6-4bfdae81c2ac admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:38.964100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-73ab7e7e-6aa7-4da6-8a43-a08e2534b307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:38.985666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 853/1696] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:38.986587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48337d98-adfe-4d8e-8bd6-4bfdae81c2ac admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:39.000128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7e7e-6aa7-4da6-8a43-a08e2534b307 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:39.009010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48337d98-adfe-4d8e-8bd6-4bfdae81c2ac admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:39.010885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:39.012559 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:39.013285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:39.013285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] PATH_INFO: `/v3/projects/914d718d76514bd78cfea50540b8ad60` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:39.014731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914d718d76514bd78cfea50540b8ad60)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:39.017115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:39.023268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a1d8a-7f5e-4996-83ec-fa4b8b14676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:39.023961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1d8a-7f5e-4996-83ec-fa4b8b14676a admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:39.024462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1d8a-7f5e-4996-83ec-fa4b8b14676a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:39.024747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1d8a-7f5e-4996-83ec-fa4b8b14676a admin admin] PATH_INFO: `/v3/projects/93020fec61e544769fd2772d6757ba24/users/d6d9ea164d0c4e96b1faccf44601317e/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:39.069021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a1d8a-7f5e-4996-83ec-fa4b8b14676a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93020fec61e544769fd2772d6757ba24, user_id=d6d9ea164d0c4e96b1faccf44601317e, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:39.092846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a1d8a-7f5e-4996-83ec-fa4b8b14676a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:39.152112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 854/1697] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:38 2022] PUT /identity/v3/projects/93020fec61e544769fd2772d6757ba24/users/d6d9ea164d0c4e96b1faccf44601317e/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:39.153744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dca72f-fcb8-45b4-9bbb-f81a4f756c45 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:39.154483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dca72f-fcb8-45b4-9bbb-f81a4f756c45 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:39.154825 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dca72f-fcb8-45b4-9bbb-f81a4f756c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:39.246034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914d718d76514bd78cfea50540b8ad60', 'request_id': 'req-07b6cb78-1504-428d-befd-f25ce9948f34'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:39.263338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914d718d76514bd78cfea50540b8ad60', 'request_id': 'req-07b6cb78-1504-428d-befd-f25ce9948f34'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:39.272607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c6dca72f-fcb8-45b4-9bbb-f81a4f756c45 None None] MFA Rules not processed for user `e01d1012d66b46b0806c9b77bfd161a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:39.276484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914d718d76514bd78cfea50540b8ad60', 'request_id': 'req-07b6cb78-1504-428d-befd-f25ce9948f34'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:39.279922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6dca72f-fcb8-45b4-9bbb-f81a4f756c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:39.297908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] The token cache is being invalidate because project 914d718d76514bd78cfea50540b8ad60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:08:39.298333 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:39.299211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:39.305250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 844/1698] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:08:38 2022] DELETE /identity/v3/projects/914d718d76514bd78cfea50540b8ad60 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:39.307422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:39.309157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:39.445511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6cb78-1504-428d-befd-f25ce9948f34 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:39.459916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8bb2b-9897-4df9-9d97-61127bc9f117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:39.463837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8bb2b-9897-4df9-9d97-61127bc9f117 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:39.464276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8bb2b-9897-4df9-9d97-61127bc9f117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:39.464716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8bb2b-9897-4df9-9d97-61127bc9f117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:39.467194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8bb2b-9897-4df9-9d97-61127bc9f117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:39.471727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8bb2b-9897-4df9-9d97-61127bc9f117 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:39.483575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 855/1699] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:39.485422 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dca72f-fcb8-45b4-9bbb-f81a4f756c45 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:39.487108 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:39.487922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6dca72f-fcb8-45b4-9bbb-f81a4f756c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:39.516737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 845/1700] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:39.519674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c851a6-0143-4192-9672-b24c8a30af44 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:39.522374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c851a6-0143-4192-9672-b24c8a30af44 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:39.523102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c851a6-0143-4192-9672-b24c8a30af44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:39.523445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dca72f-fcb8-45b4-9bbb-f81a4f756c45 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:39.534185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:39.536713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:39.539082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:39.540115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] PATH_INFO: `/v3/users/5892d7bc3b3c4dc19a398a72f2c0700d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:39.541932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5892d7bc3b3c4dc19a398a72f2c0700d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:39.548953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:39.571002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-81c851a6-0143-4192-9672-b24c8a30af44 None None] MFA Rules not processed for user `e01d1012d66b46b0806c9b77bfd161a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:39.574617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-81c851a6-0143-4192-9672-b24c8a30af44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:39.596817 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 846/1701] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:39.598699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c851a6-0143-4192-9672-b24c8a30af44 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:39.616133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c851a6-0143-4192-9672-b24c8a30af44 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:39.622971 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d8847-42d7-41f3-a08e-dd3cf0e87119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:39.628526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d8847-42d7-41f3-a08e-dd3cf0e87119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:39.628873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d8847-42d7-41f3-a08e-dd3cf0e87119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:39.629224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d8847-42d7-41f3-a08e-dd3cf0e87119 admin admin] PATH_INFO: `/v3/projects/93020fec61e544769fd2772d6757ba24/users/d6d9ea164d0c4e96b1faccf44601317e/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:39.632138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d8847-42d7-41f3-a08e-dd3cf0e87119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93020fec61e544769fd2772d6757ba24, user_id=d6d9ea164d0c4e96b1faccf44601317e, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:39.636043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d8847-42d7-41f3-a08e-dd3cf0e87119 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:39.655329 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:39.687567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5892d7bc3b3c4dc19a398a72f2c0700d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:39.692843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5892d7bc3b3c4dc19a398a72f2c0700d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:39.694305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 847/1702] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:39 2022] PUT /identity/v3/projects/93020fec61e544769fd2772d6757ba24/users/d6d9ea164d0c4e96b1faccf44601317e/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:39.696472 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d8847-42d7-41f3-a08e-dd3cf0e87119 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:39.701007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a45d8847-42d7-41f3-a08e-dd3cf0e87119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:39.716350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5892d7bc3b3c4dc19a398a72f2c0700d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:39.761634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5892d7bc3b3c4dc19a398a72f2c0700d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:39.780942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-aff9087f-68b5-44b7-a937-621a6f030b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5892d7bc3b3c4dc19a398a72f2c0700d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:39.801794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 856/1703] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:39 2022] DELETE /identity/v3/users/5892d7bc3b3c4dc19a398a72f2c0700d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:39.803700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6710f0-4451-459a-8393-5831acc15cd7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:39.821180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6710f0-4451-459a-8393-5831acc15cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:39.823100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6710f0-4451-459a-8393-5831acc15cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:39.972703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9c6710f0-4451-459a-8393-5831acc15cd7 None None] MFA Rules not processed for user `d6d9ea164d0c4e96b1faccf44601317e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:39.976023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9c6710f0-4451-459a-8393-5831acc15cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:40.061756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d8847-42d7-41f3-a08e-dd3cf0e87119 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:40.400099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d4021-2b96-4a89-8a31-d5ddbc887f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:40.400723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d4021-2b96-4a89-8a31-d5ddbc887f34 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:40.404592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d4021-2b96-4a89-8a31-d5ddbc887f34 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:40.404984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d4021-2b96-4a89-8a31-d5ddbc887f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:40.408950 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-545d4021-2b96-4a89-8a31-d5ddbc887f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:40.414971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 857/1704] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 613 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:40.416771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6710f0-4451-459a-8393-5831acc15cd7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:40.422649 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9c6710f0-4451-459a-8393-5831acc15cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:40.598906 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d4021-2b96-4a89-8a31-d5ddbc887f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:40.606614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d4021-2b96-4a89-8a31-d5ddbc887f34 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:40.639738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 848/1705] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 945 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:40.640647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d4021-2b96-4a89-8a31-d5ddbc887f34 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:40.649970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-545d4021-2b96-4a89-8a31-d5ddbc887f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:40.702885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6710f0-4451-459a-8393-5831acc15cd7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:40.716798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945067e6-45bf-4dde-bb41-a4f2a95c0912 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:40.717458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945067e6-45bf-4dde-bb41-a4f2a95c0912 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:40.717748 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945067e6-45bf-4dde-bb41-a4f2a95c0912 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:40.728071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945067e6-45bf-4dde-bb41-a4f2a95c0912 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:40.728597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:40.730601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-945067e6-45bf-4dde-bb41-a4f2a95c0912 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:40.755084 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945067e6-45bf-4dde-bb41-a4f2a95c0912 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:40.757212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945067e6-45bf-4dde-bb41-a4f2a95c0912 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:40.778389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 858/1706] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:40.881264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d4021-2b96-4a89-8a31-d5ddbc887f34 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:40.892037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7df919-5823-47b4-990d-c298a87c0585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:40.894023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7df919-5823-47b4-990d-c298a87c0585 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:40.894984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7df919-5823-47b4-990d-c298a87c0585 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:40.895778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7df919-5823-47b4-990d-c298a87c0585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:40.923783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7df919-5823-47b4-990d-c298a87c0585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:40.927023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7df919-5823-47b4-990d-c298a87c0585 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:40.971515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 849/1707] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:40 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:41.265624 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945067e6-45bf-4dde-bb41-a4f2a95c0912 service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:41.282644 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945067e6-45bf-4dde-bb41-a4f2a95c0912 service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:41.312262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de403e-d858-481b-9e69-60202bd6bc15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:41.312262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de403e-d858-481b-9e69-60202bd6bc15 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:41.312513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de403e-d858-481b-9e69-60202bd6bc15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:41.318620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de403e-d858-481b-9e69-60202bd6bc15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:41.344280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6de403e-d858-481b-9e69-60202bd6bc15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:41.359849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18838763-45e0-42d7-ab16-349d931cf3a5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:41.360283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18838763-45e0-42d7-ab16-349d931cf3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:41.361695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18838763-45e0-42d7-ab16-349d931cf3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:41.433459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-18838763-45e0-42d7-ab16-349d931cf3a5 None None] MFA Rules not processed for user `f7eebe335f274e7aaabb0266583caf89`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:41.437266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-18838763-45e0-42d7-ab16-349d931cf3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:41.565678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 850/1708] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:41.567330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18838763-45e0-42d7-ab16-349d931cf3a5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:41.568902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-18838763-45e0-42d7-ab16-349d931cf3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:41.602160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:41.740222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18838763-45e0-42d7-ab16-349d931cf3a5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:41.746156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de403e-d858-481b-9e69-60202bd6bc15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:41.746338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:41.747001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:41.747339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:41.747624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] PATH_INFO: `/v3/projects/5671acdf67bc4b7ab752ffc085ef753d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:41.748886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5671acdf67bc4b7ab752ffc085ef753d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:41.755369 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:41.757960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de403e-d858-481b-9e69-60202bd6bc15 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:41.798234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 859/1709] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:41.799357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de403e-d858-481b-9e69-60202bd6bc15 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:41.805302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6de403e-d858-481b-9e69-60202bd6bc15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:41.844233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de403e-d858-481b-9e69-60202bd6bc15 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:41.857683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:41.859370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:41.860682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:41.862034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] PATH_INFO: `/v3/projects/09ba19caf1c04c928e195b7a04ece3a6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:41.866943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ba19caf1c04c928e195b7a04ece3a6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:41.872937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:41.949503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5671acdf67bc4b7ab752ffc085ef753d', 'request_id': 'req-4c8cc137-70b5-4f29-ae39-bd88f01945f3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:41.980237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5671acdf67bc4b7ab752ffc085ef753d', 'request_id': 'req-4c8cc137-70b5-4f29-ae39-bd88f01945f3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:42.000974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5671acdf67bc4b7ab752ffc085ef753d', 'request_id': 'req-4c8cc137-70b5-4f29-ae39-bd88f01945f3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:42.012106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:42.033975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] The token cache is being invalidate because project 5671acdf67bc4b7ab752ffc085ef753d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:08:42.034771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:42.037569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8cc137-70b5-4f29-ae39-bd88f01945f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:42.039826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 851/1710] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:08:41 2022] DELETE /identity/v3/projects/5671acdf67bc4b7ab752ffc085ef753d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:42.046323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec704-b562-4760-beea-38cf83c5a348 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.047444 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec704-b562-4760-beea-38cf83c5a348 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.047781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec704-b562-4760-beea-38cf83c5a348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.052594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ba19caf1c04c928e195b7a04ece3a6', 'request_id': 'req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:42.078900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ba19caf1c04c928e195b7a04ece3a6', 'request_id': 'req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:42.096527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-136ec704-b562-4760-beea-38cf83c5a348 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:42.099288 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ba19caf1c04c928e195b7a04ece3a6', 'request_id': 'req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:42.104566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-136ec704-b562-4760-beea-38cf83c5a348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:42.119157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] The token cache is being invalidate because project 09ba19caf1c04c928e195b7a04ece3a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:08:42.119468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:42.121521 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba5bbb8c-ef92-4367-a78e-4062b86f6cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:42.126106 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 860/1711] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:08:41 2022] DELETE /identity/v3/projects/09ba19caf1c04c928e195b7a04ece3a6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:42.130771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2fc56-e301-4254-ad46-be396c65fea0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.131545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2fc56-e301-4254-ad46-be396c65fea0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.132035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2fc56-e301-4254-ad46-be396c65fea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.182797 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5af2fc56-e301-4254-ad46-be396c65fea0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:42.184629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5af2fc56-e301-4254-ad46-be396c65fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:42.270113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 852/1712] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:08:42.271041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793678-1822-4d51-9d69-242117320672 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.271509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793678-1822-4d51-9d69-242117320672 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.271852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793678-1822-4d51-9d69-242117320672 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.273437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 853/1713] 10.222.0.83 () {54 vars in 912 bytes} [Wed Aug 31 01:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:08:42.280839 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e9695-da81-4c07-9765-314c5decae6f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.281236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e9695-da81-4c07-9765-314c5decae6f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.281879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e9695-da81-4c07-9765-314c5decae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.311330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e74e9695-da81-4c07-9765-314c5decae6f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:42.312684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e74e9695-da81-4c07-9765-314c5decae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:42.323584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 854/1714] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:42.325311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b55b29-c67e-49b4-9a8e-e4238bdc9bd4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.325881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b55b29-c67e-49b4-9a8e-e4238bdc9bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.326397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b55b29-c67e-49b4-9a8e-e4238bdc9bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.377920 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 861/1715] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:42.379986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2fc56-e301-4254-ad46-be396c65fea0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:42.381535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c2b55b29-c67e-49b4-9a8e-e4238bdc9bd4 None None] MFA Rules not processed for user `f6c13711596647178ad3f93865eca187`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:42.383154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c2b55b29-c67e-49b4-9a8e-e4238bdc9bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:42.396975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2fc56-e301-4254-ad46-be396c65fea0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:42.414617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebd3be-4412-4680-8070-3830e990bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:42.415236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd3be-4412-4680-8070-3830e990bfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.415618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd3be-4412-4680-8070-3830e990bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.415925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd3be-4412-4680-8070-3830e990bfe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.416749 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebd3be-4412-4680-8070-3830e990bfe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:42.417118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebd3be-4412-4680-8070-3830e990bfe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:42.419025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebd3be-4412-4680-8070-3830e990bfe8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:42.505629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 862/1716] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:42.507015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8534614-a7df-4ec3-9ea0-b5e173a6c045 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.507213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8534614-a7df-4ec3-9ea0-b5e173a6c045 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.507486 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8534614-a7df-4ec3-9ea0-b5e173a6c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.514540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 855/1717] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:42.515809 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b55b29-c67e-49b4-9a8e-e4238bdc9bd4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:42.539592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b55b29-c67e-49b4-9a8e-e4238bdc9bd4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:42.553028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2121119-c680-4feb-afc0-35d6bd24cf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:42.553671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2121119-c680-4feb-afc0-35d6bd24cf9d admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.553947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2121119-c680-4feb-afc0-35d6bd24cf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.554220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2121119-c680-4feb-afc0-35d6bd24cf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.554866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2121119-c680-4feb-afc0-35d6bd24cf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:42.559233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2121119-c680-4feb-afc0-35d6bd24cf9d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:42.573954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a8534614-a7df-4ec3-9ea0-b5e173a6c045 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:42.577493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a8534614-a7df-4ec3-9ea0-b5e173a6c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:42.609781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 863/1718] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:42.610572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8534614-a7df-4ec3-9ea0-b5e173a6c045 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:42.624299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8534614-a7df-4ec3-9ea0-b5e173a6c045 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:42.636251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818192b-17ae-4c85-be54-ec202e1dde90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:42.638065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818192b-17ae-4c85-be54-ec202e1dde90 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.638358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818192b-17ae-4c85-be54-ec202e1dde90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.638642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818192b-17ae-4c85-be54-ec202e1dde90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.639340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818192b-17ae-4c85-be54-ec202e1dde90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:42.639620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818192b-17ae-4c85-be54-ec202e1dde90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:42.641461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818192b-17ae-4c85-be54-ec202e1dde90 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:42.646369 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 856/1719] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:42 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:42.647371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2121119-c680-4feb-afc0-35d6bd24cf9d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:42.676021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 864/1720] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:08:42.677857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818192b-17ae-4c85-be54-ec202e1dde90 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:42.695339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c818192b-17ae-4c85-be54-ec202e1dde90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:42.752886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2121119-c680-4feb-afc0-35d6bd24cf9d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:42.764334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afcd42-99fe-4cca-84ae-944c60118a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:42.765471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afcd42-99fe-4cca-84ae-944c60118a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.766184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afcd42-99fe-4cca-84ae-944c60118a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.766445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afcd42-99fe-4cca-84ae-944c60118a0f admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.768288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afcd42-99fe-4cca-84ae-944c60118a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:42.772723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818192b-17ae-4c85-be54-ec202e1dde90 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:42.786680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afcd42-99fe-4cca-84ae-944c60118a0f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:42.841067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:42.844917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 857/1721] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:42 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:42.847586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afcd42-99fe-4cca-84ae-944c60118a0f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:42.871554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:42.890807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afcd42-99fe-4cca-84ae-944c60118a0f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:42.914652 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaffa01-0187-4702-a24c-4d7dffe710ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:42.915361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaffa01-0187-4702-a24c-4d7dffe710ad admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.915710 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaffa01-0187-4702-a24c-4d7dffe710ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.917282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaffa01-0187-4702-a24c-4d7dffe710ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.917870 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaffa01-0187-4702-a24c-4d7dffe710ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:42.922215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaffa01-0187-4702-a24c-4d7dffe710ad admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:42.954413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9188f88-eb66-4e6c-9fdf-f09964b6babc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:42.956819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9188f88-eb66-4e6c-9fdf-f09964b6babc service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:42.959946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9188f88-eb66-4e6c-9fdf-f09964b6babc service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:42.961205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9188f88-eb66-4e6c-9fdf-f09964b6babc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:42.989690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9188f88-eb66-4e6c-9fdf-f09964b6babc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:42.995623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9188f88-eb66-4e6c-9fdf-f09964b6babc service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:43.014970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 858/1722] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:42 2022] POST /identity/v3/projects => generated 405 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:43.016842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaffa01-0187-4702-a24c-4d7dffe710ad admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:43.025029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 865/1723] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:43.026057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9188f88-eb66-4e6c-9fdf-f09964b6babc service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:43.049272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9188f88-eb66-4e6c-9fdf-f09964b6babc service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:43.191892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaffa01-0187-4702-a24c-4d7dffe710ad admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:43.211158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085a1b9-f400-48c9-847a-d834f007b535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:43.212116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085a1b9-f400-48c9-847a-d834f007b535 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:43.212785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085a1b9-f400-48c9-847a-d834f007b535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:43.213204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085a1b9-f400-48c9-847a-d834f007b535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:43.216237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085a1b9-f400-48c9-847a-d834f007b535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:43.219691 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085a1b9-f400-48c9-847a-d834f007b535 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:43.263827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdf107-6284-4493-9e69-e8052a7bd2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:43.264400 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdf107-6284-4493-9e69-e8052a7bd2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:43.264699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdf107-6284-4493-9e69-e8052a7bd2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:43.264853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 859/1724] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:43.264983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdf107-6284-4493-9e69-e8052a7bd2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:43.265638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdf107-6284-4493-9e69-e8052a7bd2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:43.267889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdf107-6284-4493-9e69-e8052a7bd2f8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:43.268379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085a1b9-f400-48c9-847a-d834f007b535 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:43.302894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085a1b9-f400-48c9-847a-d834f007b535 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:43.327264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 866/1725] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:43 2022] POST /identity/v3/users => generated 303 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:43.331037 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdf107-6284-4493-9e69-e8052a7bd2f8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:43.334319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0cc15-77d9-42a0-8459-23e1dab756d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:43.335348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0cc15-77d9-42a0-8459-23e1dab756d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:43.337498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0cc15-77d9-42a0-8459-23e1dab756d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:43.337795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0cc15-77d9-42a0-8459-23e1dab756d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:43.351111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0cc15-77d9-42a0-8459-23e1dab756d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:43.351111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0cc15-77d9-42a0-8459-23e1dab756d7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:43.372425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdf107-6284-4493-9e69-e8052a7bd2f8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:43.402376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcda5e7-2767-49ff-850a-36b10f16658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:43.403250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda5e7-2767-49ff-850a-36b10f16658e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:43.403626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda5e7-2767-49ff-850a-36b10f16658e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:43.404005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda5e7-2767-49ff-850a-36b10f16658e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:43.404789 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcda5e7-2767-49ff-850a-36b10f16658e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:43.412438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 860/1726] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:43.413578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcda5e7-2767-49ff-850a-36b10f16658e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:43.415677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0cc15-77d9-42a0-8459-23e1dab756d7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:43.434398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 867/1727] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:43.439274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcda5e7-2767-49ff-850a-36b10f16658e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:43.442358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0cc15-77d9-42a0-8459-23e1dab756d7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:43.451966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf461eb-f3a1-4543-b2d6-de9f39e5a388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:43.452736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf461eb-f3a1-4543-b2d6-de9f39e5a388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:43.453202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf461eb-f3a1-4543-b2d6-de9f39e5a388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:43.453596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf461eb-f3a1-4543-b2d6-de9f39e5a388 admin admin] PATH_INFO: `/v3/projects/7b809de73eee4b168857fcc6cdbaf4d8/users/1c76cd550e194d02969a5488fa774cd1/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:43.477147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf461eb-f3a1-4543-b2d6-de9f39e5a388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b809de73eee4b168857fcc6cdbaf4d8, user_id=1c76cd550e194d02969a5488fa774cd1, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:43.480984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf461eb-f3a1-4543-b2d6-de9f39e5a388 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:43.493924 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcda5e7-2767-49ff-850a-36b10f16658e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:43.509028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53581a30-00d3-4313-967b-643cb91c56e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:43.509658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53581a30-00d3-4313-967b-643cb91c56e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:43.509937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53581a30-00d3-4313-967b-643cb91c56e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:43.510214 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53581a30-00d3-4313-967b-643cb91c56e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:43.510866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53581a30-00d3-4313-967b-643cb91c56e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:43.516280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53581a30-00d3-4313-967b-643cb91c56e1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:43.524014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 861/1728] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:43 2022] PUT /identity/v3/projects/7b809de73eee4b168857fcc6cdbaf4d8/users/1c76cd550e194d02969a5488fa774cd1/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:43.540046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cd630-68e0-4517-a034-e7faf856fc26 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:43.540388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cd630-68e0-4517-a034-e7faf856fc26 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:43.540800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cd630-68e0-4517-a034-e7faf856fc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:43.557683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 868/1729] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:43.557683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53581a30-00d3-4313-967b-643cb91c56e1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:43.592817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53581a30-00d3-4313-967b-643cb91c56e1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:43.640173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-239cd630-68e0-4517-a034-e7faf856fc26 None None] MFA Rules not processed for user `1c76cd550e194d02969a5488fa774cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:43.643806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-239cd630-68e0-4517-a034-e7faf856fc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:43.785383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5ef79-449f-427d-91bc-71c6d4924834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:43.786155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ef79-449f-427d-91bc-71c6d4924834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:43.789326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ef79-449f-427d-91bc-71c6d4924834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:43.789688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ef79-449f-427d-91bc-71c6d4924834 admin admin] PATH_INFO: `/v3/projects/929c6a26f5984a24b4efbde6a4efd411/users/ed078469863e4b02aea95e54f04d14a0/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:43.826253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5ef79-449f-427d-91bc-71c6d4924834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929c6a26f5984a24b4efbde6a4efd411, user_id=ed078469863e4b02aea95e54f04d14a0, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:43.872476 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 862/1730] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:43.873894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cd630-68e0-4517-a034-e7faf856fc26 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:43.875433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5ef79-449f-427d-91bc-71c6d4924834 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:43.905729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cd630-68e0-4517-a034-e7faf856fc26 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:43.918666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98192b5e-9671-4bdb-94de-79170a2a0817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:43.921260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98192b5e-9671-4bdb-94de-79170a2a0817 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:43.922596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98192b5e-9671-4bdb-94de-79170a2a0817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:43.924630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98192b5e-9671-4bdb-94de-79170a2a0817 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:43.927125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98192b5e-9671-4bdb-94de-79170a2a0817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:43.931989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98192b5e-9671-4bdb-94de-79170a2a0817 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:43.936044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 869/1731] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:43 2022] PUT /identity/v3/projects/929c6a26f5984a24b4efbde6a4efd411/users/ed078469863e4b02aea95e54f04d14a0/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:43.941626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74096-0837-4164-9095-352ce9f238bd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:43.941906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74096-0837-4164-9095-352ce9f238bd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:43.942201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74096-0837-4164-9095-352ce9f238bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:43.983642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1fb74096-0837-4164-9095-352ce9f238bd None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:43.985732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1fb74096-0837-4164-9095-352ce9f238bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:43.998638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:44.007011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 863/1732] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:43 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:44.015528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98192b5e-9671-4bdb-94de-79170a2a0817 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:44.074842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:44.174110 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 870/1733] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:08:44.182557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74096-0837-4164-9095-352ce9f238bd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:44.184180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1fb74096-0837-4164-9095-352ce9f238bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:44.250139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98192b5e-9671-4bdb-94de-79170a2a0817 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:44.293635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a79b4-5980-4024-9177-8681c2992f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:44.293635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a79b4-5980-4024-9177-8681c2992f53 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:44.293635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a79b4-5980-4024-9177-8681c2992f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:44.293635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a79b4-5980-4024-9177-8681c2992f53 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:44.301205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a79b4-5980-4024-9177-8681c2992f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:44.312592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a79b4-5980-4024-9177-8681c2992f53 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:44.356508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 864/1734] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:44 2022] POST /identity/v3/users => generated 296 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:44.358947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a79b4-5980-4024-9177-8681c2992f53 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:44.389886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a79b4-5980-4024-9177-8681c2992f53 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:44.405361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75597699-acc9-4fbd-867d-3bf06b36d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:44.406400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597699-acc9-4fbd-867d-3bf06b36d800 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:44.407569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597699-acc9-4fbd-867d-3bf06b36d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:44.410056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597699-acc9-4fbd-867d-3bf06b36d800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:44.412876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75597699-acc9-4fbd-867d-3bf06b36d800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:44.417541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75597699-acc9-4fbd-867d-3bf06b36d800 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:44.443611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 865/1735] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:44.445900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75597699-acc9-4fbd-867d-3bf06b36d800 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:44.485839 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75597699-acc9-4fbd-867d-3bf06b36d800 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:44.506298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee99761-293c-4192-8ad0-37f81680859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:44.506997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee99761-293c-4192-8ad0-37f81680859d admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:44.513706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee99761-293c-4192-8ad0-37f81680859d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:44.513706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee99761-293c-4192-8ad0-37f81680859d admin admin] PATH_INFO: `/v3/projects/0ee63ebfc02e40b8abf53e044237cb7d/users/7c1048ea4c514a1c8b488cf23e78242e/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:44.527388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74096-0837-4164-9095-352ce9f238bd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:44.580803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee99761-293c-4192-8ad0-37f81680859d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee63ebfc02e40b8abf53e044237cb7d, user_id=7c1048ea4c514a1c8b488cf23e78242e, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:44.583984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee99761-293c-4192-8ad0-37f81680859d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:44.649563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a30de-064c-4be2-9e47-690643cde53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:44.655323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a30de-064c-4be2-9e47-690643cde53e service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:44.655977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a30de-064c-4be2-9e47-690643cde53e service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:44.657022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a30de-064c-4be2-9e47-690643cde53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:44.660124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 866/1736] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:44 2022] PUT /identity/v3/projects/0ee63ebfc02e40b8abf53e044237cb7d/users/7c1048ea4c514a1c8b488cf23e78242e/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:44.665598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee99761-293c-4192-8ad0-37f81680859d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:44.683545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a30de-064c-4be2-9e47-690643cde53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:44.690362 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a30de-064c-4be2-9e47-690643cde53e service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:44.735385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 871/1737] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:44.891534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee99761-293c-4192-8ad0-37f81680859d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:44.897831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b19eb-db7b-4cf7-8926-a61cbc203f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:44.898550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b19eb-db7b-4cf7-8926-a61cbc203f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:44.898884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b19eb-db7b-4cf7-8926-a61cbc203f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:44.899221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b19eb-db7b-4cf7-8926-a61cbc203f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:44.899990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b19eb-db7b-4cf7-8926-a61cbc203f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:44.901700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b19eb-db7b-4cf7-8926-a61cbc203f25 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:44.918841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 867/1738] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:08:44.923132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a30de-064c-4be2-9e47-690643cde53e service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:44.949250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a30de-064c-4be2-9e47-690643cde53e service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:44.988662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b33d-ecec-4411-b230-03893a93813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:44.990824 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b33d-ecec-4411-b230-03893a93813c admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:44.991304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b33d-ecec-4411-b230-03893a93813c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:44.991831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b33d-ecec-4411-b230-03893a93813c admin admin] PATH_INFO: `/v3/projects/0ee63ebfc02e40b8abf53e044237cb7d/users/7c1048ea4c514a1c8b488cf23e78242e/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:45.000914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16b33d-ecec-4411-b230-03893a93813c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee63ebfc02e40b8abf53e044237cb7d, user_id=7c1048ea4c514a1c8b488cf23e78242e, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:45.028465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16b33d-ecec-4411-b230-03893a93813c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:45.041259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaa078-9473-4e38-a022-ec952bfb146c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:45.042602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaa078-9473-4e38-a022-ec952bfb146c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:45.043288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaa078-9473-4e38-a022-ec952bfb146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:45.059425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 872/1739] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:44 2022] PUT /identity/v3/projects/0ee63ebfc02e40b8abf53e044237cb7d/users/7c1048ea4c514a1c8b488cf23e78242e/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:45.078642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b25ce7-40e2-4892-999b-d9b05e8ca35f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:45.079951 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b25ce7-40e2-4892-999b-d9b05e8ca35f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:45.080558 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b25ce7-40e2-4892-999b-d9b05e8ca35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:45.088093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2cfaa078-9473-4e38-a022-ec952bfb146c None None] MFA Rules not processed for user `e01d1012d66b46b0806c9b77bfd161a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:45.090423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2cfaa078-9473-4e38-a022-ec952bfb146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:45.222159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-89b25ce7-40e2-4892-999b-d9b05e8ca35f None None] MFA Rules not processed for user `7c1048ea4c514a1c8b488cf23e78242e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:45.223411 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-89b25ce7-40e2-4892-999b-d9b05e8ca35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:45.226495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 868/1740] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:45.266988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab7c8-c616-4e31-bde0-3cb4b70eae3a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:45.267318 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab7c8-c616-4e31-bde0-3cb4b70eae3a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:45.267561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab7c8-c616-4e31-bde0-3cb4b70eae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:45.290693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:45.422247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7a7ab7c8-c616-4e31-bde0-3cb4b70eae3a None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:45.425479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7a7ab7c8-c616-4e31-bde0-3cb4b70eae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:45.460748 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:45.535196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 873/1741] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:45.539417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b25ce7-40e2-4892-999b-d9b05e8ca35f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:45.543849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-89b25ce7-40e2-4892-999b-d9b05e8ca35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:45.620758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 869/1742] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:45.760063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b25ce7-40e2-4892-999b-d9b05e8ca35f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:45.781866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fd160-84a7-4300-9a0d-5d7d1fc3e330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:45.782521 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fd160-84a7-4300-9a0d-5d7d1fc3e330 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:45.782808 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fd160-84a7-4300-9a0d-5d7d1fc3e330 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:45.783095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fd160-84a7-4300-9a0d-5d7d1fc3e330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:45.817248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fd160-84a7-4300-9a0d-5d7d1fc3e330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:45.829395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fd160-84a7-4300-9a0d-5d7d1fc3e330 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:45.911467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 874/1743] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:45.988738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ab7c8-c616-4e31-bde0-3cb4b70eae3a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:45.990192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7a7ab7c8-c616-4e31-bde0-3cb4b70eae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:46.218376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ab7c8-c616-4e31-bde0-3cb4b70eae3a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:46.226884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0628a-e9c8-45e2-8a9d-219d4656cd8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:46.227970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0628a-e9c8-45e2-8a9d-219d4656cd8d service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:46.228851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0628a-e9c8-45e2-8a9d-219d4656cd8d service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:46.229349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0628a-e9c8-45e2-8a9d-219d4656cd8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:46.243759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0628a-e9c8-45e2-8a9d-219d4656cd8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:46.246158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0628a-e9c8-45e2-8a9d-219d4656cd8d service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:46.266415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 870/1744] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:08:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:08:46.383552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fd160-84a7-4300-9a0d-5d7d1fc3e330 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:46.396023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fd160-84a7-4300-9a0d-5d7d1fc3e330 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:46.418975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94575b9c-6768-4896-a449-9dede8915d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:46.419660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94575b9c-6768-4896-a449-9dede8915d45 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:46.419949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94575b9c-6768-4896-a449-9dede8915d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:46.420225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94575b9c-6768-4896-a449-9dede8915d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:46.666241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0628a-e9c8-45e2-8a9d-219d4656cd8d service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:46.668825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-83b0628a-e9c8-45e2-8a9d-219d4656cd8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:46.762565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94575b9c-6768-4896-a449-9dede8915d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:46.764484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94575b9c-6768-4896-a449-9dede8915d45 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:46.802690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 875/1745] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:46.894608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:46.976755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0628a-e9c8-45e2-8a9d-219d4656cd8d service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:46.984363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:46.985063 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:46.985409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:46.985816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] PATH_INFO: `/v3/users/2025e301202546f29a501233ba870a27` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:46.987790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2025e301202546f29a501233ba870a27)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:46.991843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:47.189121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2025e301202546f29a501233ba870a27'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:47.191370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2025e301202546f29a501233ba870a27'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:47.213707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2025e301202546f29a501233ba870a27'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:47.235124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2025e301202546f29a501233ba870a27'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:47.267495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2025e301202546f29a501233ba870a27'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:47.276608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 871/1746] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:46 2022] DELETE /identity/v3/users/2025e301202546f29a501233ba870a27 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:47.283446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4247-9257-4961-8ba3-10acef6ffd3f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:47.283732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4247-9257-4961-8ba3-10acef6ffd3f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:47.284759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4247-9257-4961-8ba3-10acef6ffd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:47.361798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9b3a4247-9257-4961-8ba3-10acef6ffd3f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:47.365851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9b3a4247-9257-4961-8ba3-10acef6ffd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:47.556530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 876/1747] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:47.615881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:47.618392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:47.826409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d63dd8-990b-4b00-b6f2-7248901ce99b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:47.850221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d02466-f733-4e60-92be-4d93f0f3217a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:47.853654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d02466-f733-4e60-92be-4d93f0f3217a service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:47.853973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d02466-f733-4e60-92be-4d93f0f3217a service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:47.854315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d02466-f733-4e60-92be-4d93f0f3217a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:47.880419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d02466-f733-4e60-92be-4d93f0f3217a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:47.884825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d02466-f733-4e60-92be-4d93f0f3217a service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:47.920024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 872/1748] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:48.218018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4247-9257-4961-8ba3-10acef6ffd3f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:48.219464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9b3a4247-9257-4961-8ba3-10acef6ffd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:48.271557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4247-9257-4961-8ba3-10acef6ffd3f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:48.319712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:48.320422 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:48.320679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:48.320950 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] PATH_INFO: `/v3/users/f1de267eb8ba419f9370756f45c585dd` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:48.339138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1de267eb8ba419f9370756f45c585dd)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:48.341368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:48.449699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:48.567806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1de267eb8ba419f9370756f45c585dd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:48.579966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1de267eb8ba419f9370756f45c585dd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:48.619985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1de267eb8ba419f9370756f45c585dd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:48.670133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1de267eb8ba419f9370756f45c585dd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:48.702415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2663dbd0-4c0a-41bb-80a1-179f586d1cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1de267eb8ba419f9370756f45c585dd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:48.741834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 877/1749] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:48 2022] DELETE /identity/v3/users/f1de267eb8ba419f9370756f45c585dd => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:48.746490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dcd8e-848e-421e-92ee-0a684d0a0eaf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:48.747797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dcd8e-848e-421e-92ee-0a684d0a0eaf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:48.747797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dcd8e-848e-421e-92ee-0a684d0a0eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:48.771294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4f13-b81e-4031-bc0f-48f2489bdf46 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:48.771605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4f13-b81e-4031-bc0f-48f2489bdf46 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:48.771861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4f13-b81e-4031-bc0f-48f2489bdf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:48.817553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0c6dcd8e-848e-421e-92ee-0a684d0a0eaf None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:48.828439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0c6dcd8e-848e-421e-92ee-0a684d0a0eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:48.829642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-973b4f13-b81e-4031-bc0f-48f2489bdf46 None None] MFA Rules not processed for user `f6c13711596647178ad3f93865eca187`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:48.831034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-973b4f13-b81e-4031-bc0f-48f2489bdf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:49.015070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 878/1750] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 31 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:49.039969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 873/1751] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:49.050429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4f13-b81e-4031-bc0f-48f2489bdf46 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:49.052163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-973b4f13-b81e-4031-bc0f-48f2489bdf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:49.111920 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4f13-b81e-4031-bc0f-48f2489bdf46 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:49.138668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bebd3a-1ff1-4d83-b0f2-6275c8d77966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:49.143385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bebd3a-1ff1-4d83-b0f2-6275c8d77966 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:49.153469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bebd3a-1ff1-4d83-b0f2-6275c8d77966 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:49.153883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bebd3a-1ff1-4d83-b0f2-6275c8d77966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:49.163554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dcd8e-848e-421e-92ee-0a684d0a0eaf None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:49.181791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bebd3a-1ff1-4d83-b0f2-6275c8d77966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:49.185094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dcd8e-848e-421e-92ee-0a684d0a0eaf None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:49.187523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bebd3a-1ff1-4d83-b0f2-6275c8d77966 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:49.200501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed2a8d-595d-4d5d-a13e-96390a88bce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:49.201157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed2a8d-595d-4d5d-a13e-96390a88bce7 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:49.204923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed2a8d-595d-4d5d-a13e-96390a88bce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:49.207198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed2a8d-595d-4d5d-a13e-96390a88bce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:49.241464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed2a8d-595d-4d5d-a13e-96390a88bce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:49.247893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed2a8d-595d-4d5d-a13e-96390a88bce7 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:49.266900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:49.276619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 879/1752] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:49.287597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 874/1753] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:50.141086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb07e2-ec9b-49ec-802c-e8661f522999 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:50.141381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb07e2-ec9b-49ec-802c-e8661f522999 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:50.141705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb07e2-ec9b-49ec-802c-e8661f522999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:50.244491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3cbb07e2-ec9b-49ec-802c-e8661f522999 None None] MFA Rules not processed for user `ed078469863e4b02aea95e54f04d14a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:50.247880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3cbb07e2-ec9b-49ec-802c-e8661f522999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:50.473639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 880/1754] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:50.478695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed2a8d-595d-4d5d-a13e-96390a88bce7 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:50.480931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b0ed2a8d-595d-4d5d-a13e-96390a88bce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:50.513356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed2a8d-595d-4d5d-a13e-96390a88bce7 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:50.523764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916ee57-0d84-40c4-b113-a0914e5a5278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:50.525526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916ee57-0d84-40c4-b113-a0914e5a5278 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:50.525821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916ee57-0d84-40c4-b113-a0914e5a5278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:50.526790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916ee57-0d84-40c4-b113-a0914e5a5278 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:50.528864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916ee57-0d84-40c4-b113-a0914e5a5278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:50.532474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916ee57-0d84-40c4-b113-a0914e5a5278 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:50.592774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 875/1755] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:50 2022] POST /identity/v3/projects => generated 403 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:50.599826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb07e2-ec9b-49ec-802c-e8661f522999 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:50.652804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb07e2-ec9b-49ec-802c-e8661f522999 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:50.711124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:50.829869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b1767-538d-4985-b54e-633c5b7dd397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:50.830513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1767-538d-4985-b54e-633c5b7dd397 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:50.830879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1767-538d-4985-b54e-633c5b7dd397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:50.831108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1767-538d-4985-b54e-633c5b7dd397 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:50.835755 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b1767-538d-4985-b54e-633c5b7dd397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:50.843531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b1767-538d-4985-b54e-633c5b7dd397 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:50.932015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 881/1756] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:50 2022] POST /identity/v3/users => generated 308 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:08:50.935996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916ee57-0d84-40c4-b113-a0914e5a5278 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:50.951867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916ee57-0d84-40c4-b113-a0914e5a5278 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:50.991276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e863e9-3e39-424c-a143-e2b8415c12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:50.992670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e863e9-3e39-424c-a143-e2b8415c12e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:50.994054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e863e9-3e39-424c-a143-e2b8415c12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:50.994696 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e863e9-3e39-424c-a143-e2b8415c12e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:50.995833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e863e9-3e39-424c-a143-e2b8415c12e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:50.998578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e863e9-3e39-424c-a143-e2b8415c12e3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:51.019453 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 876/1757] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:51.023750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b1767-538d-4985-b54e-633c5b7dd397 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:51.050713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b1767-538d-4985-b54e-633c5b7dd397 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:51.065831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9043-cb83-429c-9e81-5162c6639f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:51.066776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9043-cb83-429c-9e81-5162c6639f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:51.068352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9043-cb83-429c-9e81-5162c6639f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:51.068833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9043-cb83-429c-9e81-5162c6639f3f admin admin] PATH_INFO: `/v3/projects/1ea2e6ab7a7f40caa9540945310b9f50/users/f00fb60766ad4f87957c9010ec4064aa/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:51.106892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a9043-cb83-429c-9e81-5162c6639f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea2e6ab7a7f40caa9540945310b9f50, user_id=f00fb60766ad4f87957c9010ec4064aa, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:51.128863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a9043-cb83-429c-9e81-5162c6639f3f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:51.202638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 882/1758] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:51 2022] PUT /identity/v3/projects/1ea2e6ab7a7f40caa9540945310b9f50/users/f00fb60766ad4f87957c9010ec4064aa/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:51.208417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e863e9-3e39-424c-a143-e2b8415c12e3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:51.232853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e863e9-3e39-424c-a143-e2b8415c12e3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:51.523333 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2d91e-ad53-471d-8923-7be9059ed776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:51.524921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2d91e-ad53-471d-8923-7be9059ed776 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:51.525647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2d91e-ad53-471d-8923-7be9059ed776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:51.526143 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2d91e-ad53-471d-8923-7be9059ed776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:51.528101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2d91e-ad53-471d-8923-7be9059ed776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:51.534732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2d91e-ad53-471d-8923-7be9059ed776 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:51.561461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 877/1759] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:51.565780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9043-cb83-429c-9e81-5162c6639f3f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:51.608509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9043-cb83-429c-9e81-5162c6639f3f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:51.623419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3063846-5dec-4570-a2b1-3036375b74fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:51.626308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063846-5dec-4570-a2b1-3036375b74fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:51.627789 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063846-5dec-4570-a2b1-3036375b74fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:51.628381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063846-5dec-4570-a2b1-3036375b74fc admin admin] PATH_INFO: `/v3/projects/1ea2e6ab7a7f40caa9540945310b9f50/users/f00fb60766ad4f87957c9010ec4064aa/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:51.632597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3063846-5dec-4570-a2b1-3036375b74fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea2e6ab7a7f40caa9540945310b9f50, user_id=f00fb60766ad4f87957c9010ec4064aa, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:51.640022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3063846-5dec-4570-a2b1-3036375b74fc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:51.642200 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2d91e-ad53-471d-8923-7be9059ed776 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:51.645333 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dcd2d91e-ad53-471d-8923-7be9059ed776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:51.705323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 883/1760] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:51 2022] PUT /identity/v3/projects/1ea2e6ab7a7f40caa9540945310b9f50/users/f00fb60766ad4f87957c9010ec4064aa/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:51.716775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2d91e-ad53-471d-8923-7be9059ed776 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:51.835299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3063846-5dec-4570-a2b1-3036375b74fc admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:51.837398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b3063846-5dec-4570-a2b1-3036375b74fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:51.954648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:51.955641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:51.956978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:51.957486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] PATH_INFO: `/v3/projects/4b10de4c4943478fb2fcebe41eedc1e0` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:51.959370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b10de4c4943478fb2fcebe41eedc1e0)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:51.962456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:52.069211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3063846-5dec-4570-a2b1-3036375b74fc admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:52.117513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b10de4c4943478fb2fcebe41eedc1e0', 'request_id': 'req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.137268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b10de4c4943478fb2fcebe41eedc1e0', 'request_id': 'req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.154474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b10de4c4943478fb2fcebe41eedc1e0', 'request_id': 'req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.160354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:52.220356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] The token cache is being invalidate because project 4b10de4c4943478fb2fcebe41eedc1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:08:52.230602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.236677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.244416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 878/1761] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:08:51 2022] DELETE /identity/v3/projects/4b10de4c4943478fb2fcebe41eedc1e0 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:52.245752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:52.250114 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:52.285720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4e8b-d6e5-4c80-8773-142ebdbc5fa0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:52.287655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:52.295142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:52.295142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:52.295142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] PATH_INFO: `/v3/projects/bbcd17269b2848ad8ff87dc3e13c688f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:52.308566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbcd17269b2848ad8ff87dc3e13c688f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:52.310527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:52.313135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:52.314119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:52.314653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:52.315159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] PATH_INFO: `/v3/users/94fdee5984db450086c4d0ba791a73b2` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:52.321316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fdee5984db450086c4d0ba791a73b2)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:52.324532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:52.388285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:52.402012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fdee5984db450086c4d0ba791a73b2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.404371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fdee5984db450086c4d0ba791a73b2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.426857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fdee5984db450086c4d0ba791a73b2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.429147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbcd17269b2848ad8ff87dc3e13c688f', 'request_id': 'req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.436755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fdee5984db450086c4d0ba791a73b2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.441307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbcd17269b2848ad8ff87dc3e13c688f', 'request_id': 'req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.456749 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fdee5984db450086c4d0ba791a73b2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.465104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 879/1762] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:52 2022] DELETE /identity/v3/users/94fdee5984db450086c4d0ba791a73b2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:52.468625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbcd17269b2848ad8ff87dc3e13c688f', 'request_id': 'req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.490192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] The token cache is being invalidate because project bbcd17269b2848ad8ff87dc3e13c688f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:08:52.490524 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.491294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-96b5d00c-fd3b-4dd7-a29a-addbedbfbb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.495880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 884/1763] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:08:51 2022] DELETE /identity/v3/projects/bbcd17269b2848ad8ff87dc3e13c688f => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:08:52.497260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:52.501577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:52.749710 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1b93-2daa-4831-9570-f9bb83488d20 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:52.767276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:52.768233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:52.769461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:52.769858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] PATH_INFO: `/v3/users/d6d9ea164d0c4e96b1faccf44601317e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:52.774412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d9ea164d0c4e96b1faccf44601317e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:52.778494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:52.913858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d9ea164d0c4e96b1faccf44601317e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.914863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d9ea164d0c4e96b1faccf44601317e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.937245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d9ea164d0c4e96b1faccf44601317e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.953669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d9ea164d0c4e96b1faccf44601317e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:52.958967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:INSERT=3,keystone:DELETE=19,keystone:SELECT=78 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:52.991527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6e9ac67b-d56a-4fb8-b223-ea8c716d7756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d9ea164d0c4e96b1faccf44601317e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:53.006642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 880/1764] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:52 2022] DELETE /identity/v3/users/d6d9ea164d0c4e96b1faccf44601317e => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:53.066431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e024cf4-7918-4c4f-84ec-fefc419d7472 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:53.066431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e024cf4-7918-4c4f-84ec-fefc419d7472 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:53.066431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e024cf4-7918-4c4f-84ec-fefc419d7472 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:53.066431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 885/1765] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:08:53.222125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e23cc-ecbe-4771-a7d9-e55d6f55887b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:53.222533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e23cc-ecbe-4771-a7d9-e55d6f55887b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:53.222962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e23cc-ecbe-4771-a7d9-e55d6f55887b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:53.261098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0e8e23cc-ecbe-4771-a7d9-e55d6f55887b None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:53.263057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0e8e23cc-ecbe-4771-a7d9-e55d6f55887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:53.431439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 881/1766] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:08:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:53.475598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e024cf4-7918-4c4f-84ec-fefc419d7472 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:53.477947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1e024cf4-7918-4c4f-84ec-fefc419d7472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:53.522541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e024cf4-7918-4c4f-84ec-fefc419d7472 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:53.554116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae28392-3f16-4510-be8e-fd956a343f47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:53.554116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae28392-3f16-4510-be8e-fd956a343f47 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:53.554116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae28392-3f16-4510-be8e-fd956a343f47 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:53.554116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae28392-3f16-4510-be8e-fd956a343f47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:53.579203 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae28392-3f16-4510-be8e-fd956a343f47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:53.581536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae28392-3f16-4510-be8e-fd956a343f47 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:53.615372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 886/1767] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:56.114668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e23cc-ecbe-4771-a7d9-e55d6f55887b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:56.116368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0e8e23cc-ecbe-4771-a7d9-e55d6f55887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:56.290879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e23cc-ecbe-4771-a7d9-e55d6f55887b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:56.318862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:56.323838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:56.324464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:56.327187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] PATH_INFO: `/v3/projects/784d1be52ba9499687e63a42fe154aae` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:56.333268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=784d1be52ba9499687e63a42fe154aae)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:56.339483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:56.387840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae28392-3f16-4510-be8e-fd956a343f47 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:56.390423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7ae28392-3f16-4510-be8e-fd956a343f47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:56.438957 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae28392-3f16-4510-be8e-fd956a343f47 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:56.474265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:56.475288 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:56.476469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:56.477859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] PATH_INFO: `/v3/projects/93020fec61e544769fd2772d6757ba24` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:56.480915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93020fec61e544769fd2772d6757ba24)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:56.486598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:56.587949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784d1be52ba9499687e63a42fe154aae', 'request_id': 'req-75c11d44-f64a-4f4b-9f05-524389703a0d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:56.611902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784d1be52ba9499687e63a42fe154aae', 'request_id': 'req-75c11d44-f64a-4f4b-9f05-524389703a0d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:56.626944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784d1be52ba9499687e63a42fe154aae', 'request_id': 'req-75c11d44-f64a-4f4b-9f05-524389703a0d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:56.632191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93020fec61e544769fd2772d6757ba24', 'request_id': 'req-37d434d7-f2d7-407b-a714-2fcf1a840fa6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:56.646710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93020fec61e544769fd2772d6757ba24', 'request_id': 'req-37d434d7-f2d7-407b-a714-2fcf1a840fa6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:56.653709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] The token cache is being invalidate because project 784d1be52ba9499687e63a42fe154aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:08:56.654118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:56.654782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-75c11d44-f64a-4f4b-9f05-524389703a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:56.660380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 882/1768] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:08:56 2022] DELETE /identity/v3/projects/784d1be52ba9499687e63a42fe154aae => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:56.666788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bf9fd-38aa-44d8-8c8a-c5f466423fbe None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:56.667167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bf9fd-38aa-44d8-8c8a-c5f466423fbe None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:56.667523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bf9fd-38aa-44d8-8c8a-c5f466423fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:56.702337 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93020fec61e544769fd2772d6757ba24', 'request_id': 'req-37d434d7-f2d7-407b-a714-2fcf1a840fa6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:56.715834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:56.739596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] The token cache is being invalidate because project 93020fec61e544769fd2772d6757ba24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:08:56.740451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:56.741674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37d434d7-f2d7-407b-a714-2fcf1a840fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:56.744257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 887/1769] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:08:56 2022] DELETE /identity/v3/projects/93020fec61e544769fd2772d6757ba24 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:08:56.748780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92719b-2dd2-4e07-b03a-393e8b4b6f5d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:56.749309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92719b-2dd2-4e07-b03a-393e8b4b6f5d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:56.749846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92719b-2dd2-4e07-b03a-393e8b4b6f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:56.758826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-201bf9fd-38aa-44d8-8c8a-c5f466423fbe None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:56.765222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-201bf9fd-38aa-44d8-8c8a-c5f466423fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:56.831934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2b92719b-2dd2-4e07-b03a-393e8b4b6f5d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:56.842832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2b92719b-2dd2-4e07-b03a-393e8b4b6f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:56.929237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 883/1770] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:56.930731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973fc1-612a-487d-b80a-a7ad4829bff5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:56.941167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973fc1-612a-487d-b80a-a7ad4829bff5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:56.942374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973fc1-612a-487d-b80a-a7ad4829bff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:57.001248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-23973fc1-612a-487d-b80a-a7ad4829bff5 None None] MFA Rules not processed for user `f00fb60766ad4f87957c9010ec4064aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:57.003882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-23973fc1-612a-487d-b80a-a7ad4829bff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:57.074181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 888/1771] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:57.076985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92719b-2dd2-4e07-b03a-393e8b4b6f5d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:57.080754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2b92719b-2dd2-4e07-b03a-393e8b4b6f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:57.136563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92719b-2dd2-4e07-b03a-393e8b4b6f5d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:57.161241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:57.163518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:57.168218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:57.171303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] PATH_INFO: `/v3/users/1c76cd550e194d02969a5488fa774cd1` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:57.179195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c76cd550e194d02969a5488fa774cd1)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:57.183375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:57.189066 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 884/1772] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:56 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:57.196872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec9ed-6342-416c-8ed0-69632f1b702e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:57.202226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec9ed-6342-416c-8ed0-69632f1b702e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:57.202693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec9ed-6342-416c-8ed0-69632f1b702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:57.241420 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-878ec9ed-6342-416c-8ed0-69632f1b702e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:57.244046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-878ec9ed-6342-416c-8ed0-69632f1b702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:57.257314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 885/1773] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:57.257314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77516e-01d8-4f88-a33b-b4b95593b4a4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:57.257314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77516e-01d8-4f88-a33b-b4b95593b4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:57.257314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77516e-01d8-4f88-a33b-b4b95593b4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:57.285174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:57.303120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7f77516e-01d8-4f88-a33b-b4b95593b4a4 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:57.304701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7f77516e-01d8-4f88-a33b-b4b95593b4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:57.333531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 886/1774] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:57.334598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77516e-01d8-4f88-a33b-b4b95593b4a4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:57.346275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c76cd550e194d02969a5488fa774cd1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:57.355647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77516e-01d8-4f88-a33b-b4b95593b4a4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:57.356768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c76cd550e194d02969a5488fa774cd1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:57.368091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9146d-edee-4cc2-b470-8a6142369aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:57.368786 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9146d-edee-4cc2-b470-8a6142369aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:57.369140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9146d-edee-4cc2-b470-8a6142369aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:57.369427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9146d-edee-4cc2-b470-8a6142369aeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:57.370350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9146d-edee-4cc2-b470-8a6142369aeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:57.371047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9146d-edee-4cc2-b470-8a6142369aeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:57.373415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9146d-edee-4cc2-b470-8a6142369aeb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:57.375194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c76cd550e194d02969a5488fa774cd1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:57.392437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c76cd550e194d02969a5488fa774cd1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:57.404591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 887/1775] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:57.404591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9146d-edee-4cc2-b470-8a6142369aeb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:57.407169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c76cd550e194d02969a5488fa774cd1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:57.423872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 889/1776] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:57 2022] DELETE /identity/v3/users/1c76cd550e194d02969a5488fa774cd1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:57.427312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9146d-edee-4cc2-b470-8a6142369aeb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:57.427959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:57.430193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:57.569886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc529ab-e029-4cc1-a691-89b622ad8840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:57.571260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc529ab-e029-4cc1-a691-89b622ad8840 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:57.571560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc529ab-e029-4cc1-a691-89b622ad8840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:57.572468 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc529ab-e029-4cc1-a691-89b622ad8840 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:57.574332 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc529ab-e029-4cc1-a691-89b622ad8840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:08:57.574648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc529ab-e029-4cc1-a691-89b622ad8840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:57.577240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc529ab-e029-4cc1-a691-89b622ad8840 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:57.594728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:57.608824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 888/1777] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:08:57.608824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8922-f29e-4229-a8ba-38610cbd5577 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:57.609103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79860b-883f-4a58-a4c2-2438dfd93e49 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:57.609198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8922-f29e-4229-a8ba-38610cbd5577 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:57.609198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8922-f29e-4229-a8ba-38610cbd5577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:57.618889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e682de-5c12-41b1-8997-068f0aacc407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:57.619780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e682de-5c12-41b1-8997-068f0aacc407 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:57.620073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e682de-5c12-41b1-8997-068f0aacc407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:57.620372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e682de-5c12-41b1-8997-068f0aacc407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:57.621323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e682de-5c12-41b1-8997-068f0aacc407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:57.627413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e682de-5c12-41b1-8997-068f0aacc407 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:57.641032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a5fb8922-f29e-4229-a8ba-38610cbd5577 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:57.643033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a5fb8922-f29e-4229-a8ba-38610cbd5577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:57.655439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 889/1778] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:57.655439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb8922-f29e-4229-a8ba-38610cbd5577 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:57.655439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a5fb8922-f29e-4229-a8ba-38610cbd5577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:57.681009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb8922-f29e-4229-a8ba-38610cbd5577 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:57.682553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 890/1779] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:57 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:57.685424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e682de-5c12-41b1-8997-068f0aacc407 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:57.708782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-20e682de-5c12-41b1-8997-068f0aacc407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:57.808096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e682de-5c12-41b1-8997-068f0aacc407 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:57.812498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9577c-327a-4dcb-b1a1-7086c8f136b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:57.813263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9577c-327a-4dcb-b1a1-7086c8f136b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:57.813555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9577c-327a-4dcb-b1a1-7086c8f136b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:57.813832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9577c-327a-4dcb-b1a1-7086c8f136b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:57.860907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde09088-386a-4987-b95e-44e868d47ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:57.861610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde09088-386a-4987-b95e-44e868d47ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:57.861903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde09088-386a-4987-b95e-44e868d47ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:57.862329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde09088-386a-4987-b95e-44e868d47ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:57.863095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde09088-386a-4987-b95e-44e868d47ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:57.868220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde09088-386a-4987-b95e-44e868d47ba2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:57.883109 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:57.954343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 890/1780] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:57 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:57.955283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde09088-386a-4987-b95e-44e868d47ba2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:57.960913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9577c-327a-4dcb-b1a1-7086c8f136b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:57.962464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9577c-327a-4dcb-b1a1-7086c8f136b7 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:57.995675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 891/1781] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:57.996665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9577c-327a-4dcb-b1a1-7086c8f136b7 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:58.013351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9577c-327a-4dcb-b1a1-7086c8f136b7 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:58.107154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde09088-386a-4987-b95e-44e868d47ba2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:58.141465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513df4d-b475-4e56-a9ce-f6455d63ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:58.150074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513df4d-b475-4e56-a9ce-f6455d63ce49 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.150713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513df4d-b475-4e56-a9ce-f6455d63ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.151494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543dd36-9aa1-44e2-ae23-a5ab32534e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:58.152032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513df4d-b475-4e56-a9ce-f6455d63ce49 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.153456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513df4d-b475-4e56-a9ce-f6455d63ce49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:58.153882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543dd36-9aa1-44e2-ae23-a5ab32534e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.154400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543dd36-9aa1-44e2-ae23-a5ab32534e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.156242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543dd36-9aa1-44e2-ae23-a5ab32534e4f admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.157053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543dd36-9aa1-44e2-ae23-a5ab32534e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:58.160889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513df4d-b475-4e56-a9ce-f6455d63ce49 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:58.164238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543dd36-9aa1-44e2-ae23-a5ab32534e4f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:58.244459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 891/1782] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:57 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:58.245471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543dd36-9aa1-44e2-ae23-a5ab32534e4f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:58.251784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 892/1783] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:57 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:58.252863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513df4d-b475-4e56-a9ce-f6455d63ce49 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:58.281879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513df4d-b475-4e56-a9ce-f6455d63ce49 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:58.299358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96643c91-7b9c-43c5-8454-4718199d6249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:58.299358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96643c91-7b9c-43c5-8454-4718199d6249 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.299358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96643c91-7b9c-43c5-8454-4718199d6249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.299358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96643c91-7b9c-43c5-8454-4718199d6249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.299981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96643c91-7b9c-43c5-8454-4718199d6249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:58.301828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96643c91-7b9c-43c5-8454-4718199d6249 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:58.324233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 893/1784] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:58.328767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543dd36-9aa1-44e2-ae23-a5ab32534e4f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:58.332873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96643c91-7b9c-43c5-8454-4718199d6249 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:58.354069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1a63-4793-4d01-855d-ac30c10be1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:58.354338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1a63-4793-4d01-855d-ac30c10be1ba admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.354630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1a63-4793-4d01-855d-ac30c10be1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.354911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1a63-4793-4d01-855d-ac30c10be1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.355585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b1a63-4793-4d01-855d-ac30c10be1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:58.358949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b1a63-4793-4d01-855d-ac30c10be1ba admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:58.359570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96643c91-7b9c-43c5-8454-4718199d6249 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:58.372410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc424bb-817a-478c-80f8-9d7990e7407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:58.373964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc424bb-817a-478c-80f8-9d7990e7407d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.374770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc424bb-817a-478c-80f8-9d7990e7407d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.375057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc424bb-817a-478c-80f8-9d7990e7407d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.375737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc424bb-817a-478c-80f8-9d7990e7407d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:58.377407 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc424bb-817a-478c-80f8-9d7990e7407d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:58.388610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 892/1785] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:58.406273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1a63-4793-4d01-855d-ac30c10be1ba admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:58.421426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 894/1786] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:58.422278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc424bb-817a-478c-80f8-9d7990e7407d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:58.437740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc424bb-817a-478c-80f8-9d7990e7407d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:58.444747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdffce6-a1b5-4dad-b563-5db0bc2a092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:58.445439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdffce6-a1b5-4dad-b563-5db0bc2a092b admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.445791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdffce6-a1b5-4dad-b563-5db0bc2a092b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.445996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdffce6-a1b5-4dad-b563-5db0bc2a092b admin admin] PATH_INFO: `/v3/projects/96eb0fe0c0de4db0ba445a7ec1ce7ef9/users/6f5e1d0a41b24b4aaa4ef81c0c64740e/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.450118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1a63-4793-4d01-855d-ac30c10be1ba admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:58.467834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdffce6-a1b5-4dad-b563-5db0bc2a092b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96eb0fe0c0de4db0ba445a7ec1ce7ef9, user_id=6f5e1d0a41b24b4aaa4ef81c0c64740e, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:58.470779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdffce6-a1b5-4dad-b563-5db0bc2a092b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:58.476449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541022-4f92-4846-94b6-b4b3c3115fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:58.477327 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541022-4f92-4846-94b6-b4b3c3115fed admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.477626 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541022-4f92-4846-94b6-b4b3c3115fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.477900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541022-4f92-4846-94b6-b4b3c3115fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.478562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541022-4f92-4846-94b6-b4b3c3115fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:58.481860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541022-4f92-4846-94b6-b4b3c3115fed admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:58.491664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 895/1787] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:58 2022] PUT /identity/v3/projects/96eb0fe0c0de4db0ba445a7ec1ce7ef9/users/6f5e1d0a41b24b4aaa4ef81c0c64740e/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:58.517857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ab742-99e2-4df7-a780-d4ce7db13912 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.523820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ab742-99e2-4df7-a780-d4ce7db13912 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.523939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 893/1788] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:58.524036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ab742-99e2-4df7-a780-d4ce7db13912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.524851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541022-4f92-4846-94b6-b4b3c3115fed admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:58.546918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541022-4f92-4846-94b6-b4b3c3115fed admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:58.634218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-131ab742-99e2-4df7-a780-d4ce7db13912 None None] MFA Rules not processed for user `6f5e1d0a41b24b4aaa4ef81c0c64740e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:58.635847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-131ab742-99e2-4df7-a780-d4ce7db13912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:58.670227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:58.701507 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318db8e3-1e01-4434-a9e9-336de7f9161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:58.702441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318db8e3-1e01-4434-a9e9-336de7f9161f admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.710965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318db8e3-1e01-4434-a9e9-336de7f9161f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.711544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318db8e3-1e01-4434-a9e9-336de7f9161f admin admin] PATH_INFO: `/v3/projects/e3242440eddd40e18100ef9831430b64/users/001c04d83032419d8cc233c18103a248/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.750892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318db8e3-1e01-4434-a9e9-336de7f9161f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3242440eddd40e18100ef9831430b64, user_id=001c04d83032419d8cc233c18103a248, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:58.764051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318db8e3-1e01-4434-a9e9-336de7f9161f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:58.811644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 894/1789] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:58 2022] PUT /identity/v3/projects/e3242440eddd40e18100ef9831430b64/users/001c04d83032419d8cc233c18103a248/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:08:58.811965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7a17-b13f-4816-b052-168470d8ed6b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.812082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7a17-b13f-4816-b052-168470d8ed6b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.816442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7a17-b13f-4816-b052-168470d8ed6b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.817955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 895/1790] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:08:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:08:58.819159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a334fb-fda4-473d-8979-a0c03edce838 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.819429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a334fb-fda4-473d-8979-a0c03edce838 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.819706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a334fb-fda4-473d-8979-a0c03edce838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.880053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d3a334fb-fda4-473d-8979-a0c03edce838 None None] MFA Rules not processed for user `001c04d83032419d8cc233c18103a248`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:58.881402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d3a334fb-fda4-473d-8979-a0c03edce838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:58.907458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 896/1791] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:58.910105 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a58a0-b69c-4a85-9ea8-9a7c5369587b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:58.910398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a58a0-b69c-4a85-9ea8-9a7c5369587b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:58.910821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a58a0-b69c-4a85-9ea8-9a7c5369587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:58.934810 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:58.957146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-141a58a0-b69c-4a85-9ea8-9a7c5369587b None None] MFA Rules not processed for user `1eb93baf45174c10a6fcbe321ac65764`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:58.958656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-141a58a0-b69c-4a85-9ea8-9a7c5369587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:59.037713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 896/1792] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:59.038960 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a334fb-fda4-473d-8979-a0c03edce838 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:59.124942 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a334fb-fda4-473d-8979-a0c03edce838 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:59.129863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 897/1793] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:59.130927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a58a0-b69c-4a85-9ea8-9a7c5369587b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:59.132562 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-141a58a0-b69c-4a85-9ea8-9a7c5369587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:59.134164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45994e6-4851-4d17-a59e-68bdf4b6ae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:59.134969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45994e6-4851-4d17-a59e-68bdf4b6ae41 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:59.135506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45994e6-4851-4d17-a59e-68bdf4b6ae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:59.135941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45994e6-4851-4d17-a59e-68bdf4b6ae41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:59.137949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45994e6-4851-4d17-a59e-68bdf4b6ae41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:59.140106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45994e6-4851-4d17-a59e-68bdf4b6ae41 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:59.184805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 897/1794] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:08:59 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:59.188151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a506c-d58d-4c36-bff4-5980e92f2b76 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:59.191221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a506c-d58d-4c36-bff4-5980e92f2b76 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:59.192583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a506c-d58d-4c36-bff4-5980e92f2b76 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:59.194223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 898/1795] 10.222.0.83 () {54 vars in 961 bytes} [Wed Aug 31 01:08:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:08:59.202841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a506c-d58d-4c36-bff4-5980e92f2b76 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:59.279375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a58a0-b69c-4a85-9ea8-9a7c5369587b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:59.288235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:59.314615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a506c-d58d-4c36-bff4-5980e92f2b76 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:59.322144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a25793-85d4-4799-9a91-1f9f52bffcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:59.323188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a25793-85d4-4799-9a91-1f9f52bffcfc admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:59.323491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a25793-85d4-4799-9a91-1f9f52bffcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:59.323921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a25793-85d4-4799-9a91-1f9f52bffcfc admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:59.324603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a25793-85d4-4799-9a91-1f9f52bffcfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:59.326912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a25793-85d4-4799-9a91-1f9f52bffcfc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:59.336787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ee71f-31ec-4238-8f52-8983933611d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb70dd34dc642cfbb49b4e1a0434399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:59.337412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ee71f-31ec-4238-8f52-8983933611d2 service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:59.338139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ee71f-31ec-4238-8f52-8983933611d2 service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:59.338421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ee71f-31ec-4238-8f52-8983933611d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:59.357720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 899/1796] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:08:59 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:08:59.360466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d047f1-d37c-4fd4-a7e1-f3d38f9165f8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:59.361107 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d047f1-d37c-4fd4-a7e1-f3d38f9165f8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:59.361538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d047f1-d37c-4fd4-a7e1-f3d38f9165f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:59.384972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b5d047f1-d37c-4fd4-a7e1-f3d38f9165f8 None None] MFA Rules not processed for user `1eb93baf45174c10a6fcbe321ac65764`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:59.386209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b5d047f1-d37c-4fd4-a7e1-f3d38f9165f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:59.399596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:08:59.412730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ee71f-31ec-4238-8f52-8983933611d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:59.416889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ee71f-31ec-4238-8f52-8983933611d2 service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:59.431908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 898/1797] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:59.433728 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ee71f-31ec-4238-8f52-8983933611d2 service glance] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:59.435932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8a7ee71f-31ec-4238-8f52-8983933611d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:59.477086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ee71f-31ec-4238-8f52-8983933611d2 service glance] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:59.493954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:59.495443 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:59.495443 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:59.495634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] PATH_INFO: `/v3/projects/7b809de73eee4b168857fcc6cdbaf4d8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:59.497345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b809de73eee4b168857fcc6cdbaf4d8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:59.499577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:59.501936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 900/1798] 10.222.0.83 () {58 vars in 1058 bytes} [Wed Aug 31 01:08:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:59.504003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dab5ae-c06b-468d-a834-a75f35d44082 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:59.504471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dab5ae-c06b-468d-a834-a75f35d44082 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:59.504837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dab5ae-c06b-468d-a834-a75f35d44082 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:59.506081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 901/1799] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:08:59.515469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dab5ae-c06b-468d-a834-a75f35d44082 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:59.582087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dab5ae-c06b-468d-a834-a75f35d44082 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:59.599810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e60fb-dcca-4c3c-bf62-5b3255ab21e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:59.600504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e60fb-dcca-4c3c-bf62-5b3255ab21e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:59.600683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e60fb-dcca-4c3c-bf62-5b3255ab21e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:59.600982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e60fb-dcca-4c3c-bf62-5b3255ab21e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:59.601769 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e60fb-dcca-4c3c-bf62-5b3255ab21e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:59.604398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e60fb-dcca-4c3c-bf62-5b3255ab21e1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:59.645596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b809de73eee4b168857fcc6cdbaf4d8', 'request_id': 'req-fecae66f-4680-4343-9232-f5fe07664f9c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:59.661323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b809de73eee4b168857fcc6cdbaf4d8', 'request_id': 'req-fecae66f-4680-4343-9232-f5fe07664f9c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:59.663595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 902/1800] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:08:59.665686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e60fb-dcca-4c3c-bf62-5b3255ab21e1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:59.690698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b809de73eee4b168857fcc6cdbaf4d8', 'request_id': 'req-fecae66f-4680-4343-9232-f5fe07664f9c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:59.705268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e60fb-dcca-4c3c-bf62-5b3255ab21e1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:08:59.713495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] The token cache is being invalidate because project 7b809de73eee4b168857fcc6cdbaf4d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:08:59.714717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:59.717156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fecae66f-4680-4343-9232-f5fe07664f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:08:59.730127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 899/1801] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:08:59 2022] DELETE /identity/v3/projects/7b809de73eee4b168857fcc6cdbaf4d8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:08:59.732132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a7f0f-f2a3-49fe-bc07-ee9091b1ce28 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:59.732289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a7f0f-f2a3-49fe-bc07-ee9091b1ce28 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:59.734907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a7f0f-f2a3-49fe-bc07-ee9091b1ce28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:59.813523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ea8a7f0f-f2a3-49fe-bc07-ee9091b1ce28 None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:08:59.818565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ea8a7f0f-f2a3-49fe-bc07-ee9091b1ce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:59.917741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc13c1-efdf-4bda-b0a5-dce112677ec7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:08:59.919941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc13c1-efdf-4bda-b0a5-dce112677ec7 service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:08:59.919941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc13c1-efdf-4bda-b0a5-dce112677ec7 service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:08:59.920836 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc13c1-efdf-4bda-b0a5-dce112677ec7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:08:59.927194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3adc13c1-efdf-4bda-b0a5-dce112677ec7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:59.958699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc13c1-efdf-4bda-b0a5-dce112677ec7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:08:59.963730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc13c1-efdf-4bda-b0a5-dce112677ec7 service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:08:59.991682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 900/1802] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:08:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:08:59.992628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a7f0f-f2a3-49fe-bc07-ee9091b1ce28 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:08:59.994557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ea8a7f0f-f2a3-49fe-bc07-ee9091b1ce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:08:59.998129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 903/1803] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:08:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:08:59.999051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc13c1-efdf-4bda-b0a5-dce112677ec7 service placement] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:00.003644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3adc13c1-efdf-4bda-b0a5-dce112677ec7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:00.111243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a7f0f-f2a3-49fe-bc07-ee9091b1ce28 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:00.119369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc69a12-60b4-41a9-b894-5ab14ce88e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:00.120062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69a12-60b4-41a9-b894-5ab14ce88e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:00.120366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69a12-60b4-41a9-b894-5ab14ce88e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:00.120654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69a12-60b4-41a9-b894-5ab14ce88e7e admin admin] PATH_INFO: `/v3/projects/ddb6d6a3e3224a1988e80ee8b61cf8f0/users/211bed11516f47a1a7ad5dfbb01d4953/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:00.141597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:00.155067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:00.156043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc69a12-60b4-41a9-b894-5ab14ce88e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb6d6a3e3224a1988e80ee8b61cf8f0, user_id=211bed11516f47a1a7ad5dfbb01d4953, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:00.164676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc69a12-60b4-41a9-b894-5ab14ce88e7e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:00.184246 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc13c1-efdf-4bda-b0a5-dce112677ec7 service placement] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:00.193451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 901/1804] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:08:59 2022] PUT /identity/v3/projects/ddb6d6a3e3224a1988e80ee8b61cf8f0/users/211bed11516f47a1a7ad5dfbb01d4953/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:00.195511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc69a12-60b4-41a9-b894-5ab14ce88e7e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:00.201904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-efc69a12-60b4-41a9-b894-5ab14ce88e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:00.276262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:00.277011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:00.278510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:00.280403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] PATH_INFO: `/v3/users/7c1048ea4c514a1c8b488cf23e78242e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:00.312012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1048ea4c514a1c8b488cf23e78242e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:00.315400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:00.323501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc69a12-60b4-41a9-b894-5ab14ce88e7e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:00.333009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:00.333607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:00.333893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:00.334285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] PATH_INFO: `/v3/users/ed078469863e4b02aea95e54f04d14a0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:00.335516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed078469863e4b02aea95e54f04d14a0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:00.337522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:00.413178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed078469863e4b02aea95e54f04d14a0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.416954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed078469863e4b02aea95e54f04d14a0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.423613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1048ea4c514a1c8b488cf23e78242e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.424987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1048ea4c514a1c8b488cf23e78242e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.426803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed078469863e4b02aea95e54f04d14a0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.432601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1048ea4c514a1c8b488cf23e78242e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.441334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1048ea4c514a1c8b488cf23e78242e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.446430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed078469863e4b02aea95e54f04d14a0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.454979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed078469863e4b02aea95e54f04d14a0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.456506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1048ea4c514a1c8b488cf23e78242e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.462441 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 902/1805] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:00 2022] DELETE /identity/v3/users/ed078469863e4b02aea95e54f04d14a0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:00.463367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:00.464967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:00.465405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 904/1806] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:08:59 2022] DELETE /identity/v3/users/7c1048ea4c514a1c8b488cf23e78242e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:00.474556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:00.482238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:00.581967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adccc93-364f-4116-9f52-ba90d387985b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:00.599637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66c70c-5fba-45fc-8099-aae4bf5fe127 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:00.607378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93524f8b-109c-427d-8029-08201e32c61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:00.608841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93524f8b-109c-427d-8029-08201e32c61d service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:00.609795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93524f8b-109c-427d-8029-08201e32c61d service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:00.610796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93524f8b-109c-427d-8029-08201e32c61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:00.613702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-93524f8b-109c-427d-8029-08201e32c61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:00.615017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:00.635045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93524f8b-109c-427d-8029-08201e32c61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:00.637284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93524f8b-109c-427d-8029-08201e32c61d service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:00.647779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:00.665630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 905/1807] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:00.714860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91afca3-1859-4e53-9697-6f1129e901e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:00.715545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91afca3-1859-4e53-9697-6f1129e901e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:00.715831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91afca3-1859-4e53-9697-6f1129e901e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:00.716161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91afca3-1859-4e53-9697-6f1129e901e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:00.717129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91afca3-1859-4e53-9697-6f1129e901e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:00.719173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93524f8b-109c-427d-8029-08201e32c61d service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:00.722225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-93524f8b-109c-427d-8029-08201e32c61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:00.727871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91afca3-1859-4e53-9697-6f1129e901e3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:00.757112 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93524f8b-109c-427d-8029-08201e32c61d service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:00.762998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 903/1808] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:00.779982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:00.789230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:00.790327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91afca3-1859-4e53-9697-6f1129e901e3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:00.790667 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:00.800768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] PATH_INFO: `/v3/projects/929c6a26f5984a24b4efbde6a4efd411` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:00.803057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=929c6a26f5984a24b4efbde6a4efd411)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:00.808087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:00.820417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91afca3-1859-4e53-9697-6f1129e901e3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:00.834736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0d6e7-f8bc-4416-9ca3-a99604757f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:00.836418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0d6e7-f8bc-4416-9ca3-a99604757f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:00.836418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0d6e7-f8bc-4416-9ca3-a99604757f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:00.836418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0d6e7-f8bc-4416-9ca3-a99604757f49 admin admin] PATH_INFO: `/v3/projects/ddb6d6a3e3224a1988e80ee8b61cf8f0/users/211bed11516f47a1a7ad5dfbb01d4953/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:00.838135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0d6e7-f8bc-4416-9ca3-a99604757f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb6d6a3e3224a1988e80ee8b61cf8f0, user_id=211bed11516f47a1a7ad5dfbb01d4953, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:00.840868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0d6e7-f8bc-4416-9ca3-a99604757f49 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:00.873828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 904/1809] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:00 2022] PUT /identity/v3/projects/ddb6d6a3e3224a1988e80ee8b61cf8f0/users/211bed11516f47a1a7ad5dfbb01d4953/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:00.887863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bac638-f5b9-455b-bc22-98c586aa6720 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:00.888208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bac638-f5b9-455b-bc22-98c586aa6720 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:00.888528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bac638-f5b9-455b-bc22-98c586aa6720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:00.914110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929c6a26f5984a24b4efbde6a4efd411', 'request_id': 'req-1a068b22-e89d-4356-ba56-d4b287b802c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.922798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929c6a26f5984a24b4efbde6a4efd411', 'request_id': 'req-1a068b22-e89d-4356-ba56-d4b287b802c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.928353 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-57bac638-f5b9-455b-bc22-98c586aa6720 None None] MFA Rules not processed for user `211bed11516f47a1a7ad5dfbb01d4953`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:00.932999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-57bac638-f5b9-455b-bc22-98c586aa6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:00.939198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929c6a26f5984a24b4efbde6a4efd411', 'request_id': 'req-1a068b22-e89d-4356-ba56-d4b287b802c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.963377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] The token cache is being invalidate because project 929c6a26f5984a24b4efbde6a4efd411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:00.964299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.967647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:00.970192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 906/1810] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:00 2022] DELETE /identity/v3/projects/929c6a26f5984a24b4efbde6a4efd411 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:00.974358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:00.978008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:01.075085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 905/1811] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:01.087048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bac638-f5b9-455b-bc22-98c586aa6720 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:01.087048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-57bac638-f5b9-455b-bc22-98c586aa6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:01.113367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a068b22-e89d-4356-ba56-d4b287b802c8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:01.125812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:01.126850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:01.127398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:01.128504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] PATH_INFO: `/v3/users/f00fb60766ad4f87957c9010ec4064aa` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:01.137032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00fb60766ad4f87957c9010ec4064aa)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:01.139126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:01.249966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bac638-f5b9-455b-bc22-98c586aa6720 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:01.255556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193b63-9204-48b2-8500-d8e68519371b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:01.256604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193b63-9204-48b2-8500-d8e68519371b service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:01.257273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193b63-9204-48b2-8500-d8e68519371b service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:01.257705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193b63-9204-48b2-8500-d8e68519371b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:01.261911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00fb60766ad4f87957c9010ec4064aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:01.263084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00fb60766ad4f87957c9010ec4064aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:01.276187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00fb60766ad4f87957c9010ec4064aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:01.278239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a193b63-9204-48b2-8500-d8e68519371b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:01.280745 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a193b63-9204-48b2-8500-d8e68519371b service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:01.291194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00fb60766ad4f87957c9010ec4064aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:01.303687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 906/1812] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:01.322751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8c618c43-0cc0-4deb-abcf-0bd48a3f458d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00fb60766ad4f87957c9010ec4064aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:01.327067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:01.336286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 907/1813] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:00 2022] DELETE /identity/v3/users/f00fb60766ad4f87957c9010ec4064aa => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:01.543671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193b63-9204-48b2-8500-d8e68519371b service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:01.545620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3a193b63-9204-48b2-8500-d8e68519371b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:01.578626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193b63-9204-48b2-8500-d8e68519371b service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:01.688915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:01.770207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:01.771476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:01.772164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:01.772851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] PATH_INFO: `/v3/projects/0ee63ebfc02e40b8abf53e044237cb7d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:01.774698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee63ebfc02e40b8abf53e044237cb7d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:01.778691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:01.898565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee63ebfc02e40b8abf53e044237cb7d', 'request_id': 'req-39c410cb-6249-4896-9471-cf41d902a8f9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:01.905394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee63ebfc02e40b8abf53e044237cb7d', 'request_id': 'req-39c410cb-6249-4896-9471-cf41d902a8f9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:01.923961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee63ebfc02e40b8abf53e044237cb7d', 'request_id': 'req-39c410cb-6249-4896-9471-cf41d902a8f9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:01.951281 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] The token cache is being invalidate because project 0ee63ebfc02e40b8abf53e044237cb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:01.951585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:01.953201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-39c410cb-6249-4896-9471-cf41d902a8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:01.958280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 907/1814] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:01 2022] DELETE /identity/v3/projects/0ee63ebfc02e40b8abf53e044237cb7d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:01.963159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560298db-2fec-4419-808a-0efaea2803bf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:01.963714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560298db-2fec-4419-808a-0efaea2803bf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:01.964464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560298db-2fec-4419-808a-0efaea2803bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.009641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-560298db-2fec-4419-808a-0efaea2803bf None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:02.013353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-560298db-2fec-4419-808a-0efaea2803bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:02.146425 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 908/1815] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:02.152613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee86c3-b6a1-491a-9c98-536c1018e8da None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.152613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee86c3-b6a1-491a-9c98-536c1018e8da None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.152613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee86c3-b6a1-491a-9c98-536c1018e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.181716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-55ee86c3-b6a1-491a-9c98-536c1018e8da None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:02.183209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-55ee86c3-b6a1-491a-9c98-536c1018e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:02.196283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 908/1816] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:02.200516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560298db-2fec-4419-808a-0efaea2803bf None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.222712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560298db-2fec-4419-808a-0efaea2803bf None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:02.241915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcf530-f132-4407-bd58-b0bf1fe782da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:02.242795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf530-f132-4407-bd58-b0bf1fe782da admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.243291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf530-f132-4407-bd58-b0bf1fe782da admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.243784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf530-f132-4407-bd58-b0bf1fe782da admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.244691 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcf530-f132-4407-bd58-b0bf1fe782da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:02.245217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcf530-f132-4407-bd58-b0bf1fe782da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:02.248884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcf530-f132-4407-bd58-b0bf1fe782da admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:02.284985 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 909/1817] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:02.290935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee86c3-b6a1-491a-9c98-536c1018e8da None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.303246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee86c3-b6a1-491a-9c98-536c1018e8da None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:02.308838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290ab29-16b2-4119-95cf-a1e18f232a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:02.309544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290ab29-16b2-4119-95cf-a1e18f232a10 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.309896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290ab29-16b2-4119-95cf-a1e18f232a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.310246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290ab29-16b2-4119-95cf-a1e18f232a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.311059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290ab29-16b2-4119-95cf-a1e18f232a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:02.313079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290ab29-16b2-4119-95cf-a1e18f232a10 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:02.347576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 909/1818] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:02 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:02.351676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcf530-f132-4407-bd58-b0bf1fe782da admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.362859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcf530-f132-4407-bd58-b0bf1fe782da admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:02.449117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290ab29-16b2-4119-95cf-a1e18f232a10 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.450961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4290ab29-16b2-4119-95cf-a1e18f232a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:02.461361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13125e-af4c-49f1-8d9d-c5c3f5dab9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:02.461996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13125e-af4c-49f1-8d9d-c5c3f5dab9bc admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.462286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13125e-af4c-49f1-8d9d-c5c3f5dab9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.462626 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13125e-af4c-49f1-8d9d-c5c3f5dab9bc admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.463277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13125e-af4c-49f1-8d9d-c5c3f5dab9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:02.467163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13125e-af4c-49f1-8d9d-c5c3f5dab9bc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:02.499733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 910/1819] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:02 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:02.504046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13125e-af4c-49f1-8d9d-c5c3f5dab9bc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.521265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13125e-af4c-49f1-8d9d-c5c3f5dab9bc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:02.536382 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66ef81-9c12-4a21-9de4-517f9047ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:02.537264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66ef81-9c12-4a21-9de4-517f9047ad58 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.538525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66ef81-9c12-4a21-9de4-517f9047ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.538882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66ef81-9c12-4a21-9de4-517f9047ad58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.539627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66ef81-9c12-4a21-9de4-517f9047ad58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:02.543331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66ef81-9c12-4a21-9de4-517f9047ad58 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:02.553685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 911/1820] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:02.554901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66ef81-9c12-4a21-9de4-517f9047ad58 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.560295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7a66ef81-9c12-4a21-9de4-517f9047ad58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:02.572558 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290ab29-16b2-4119-95cf-a1e18f232a10 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:02.573782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66ef81-9c12-4a21-9de4-517f9047ad58 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:02.577415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:02.578056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.578340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.578576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:02.578697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] PATH_INFO: `/v3/projects/1ea2e6ab7a7f40caa9540945310b9f50` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.579203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.579490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.579733 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea2e6ab7a7f40caa9540945310b9f50)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:02.579833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] PATH_INFO: `/v3/users/6f5e1d0a41b24b4aaa4ef81c0c64740e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.580964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5e1d0a41b24b4aaa4ef81c0c64740e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:02.581893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:02.583226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:02.629777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:02.641770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5e1d0a41b24b4aaa4ef81c0c64740e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:02.642443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5e1d0a41b24b4aaa4ef81c0c64740e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:02.646175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea2e6ab7a7f40caa9540945310b9f50', 'request_id': 'req-af3fdae9-265f-4c98-82f0-6a967876dd5b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:02.650206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5e1d0a41b24b4aaa4ef81c0c64740e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:02.652313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea2e6ab7a7f40caa9540945310b9f50', 'request_id': 'req-af3fdae9-265f-4c98-82f0-6a967876dd5b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:02.655978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:02.658991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5e1d0a41b24b4aaa4ef81c0c64740e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:02.661453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea2e6ab7a7f40caa9540945310b9f50', 'request_id': 'req-af3fdae9-265f-4c98-82f0-6a967876dd5b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:02.676237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b4c119e0-bb35-4813-875b-d35a6f659093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5e1d0a41b24b4aaa4ef81c0c64740e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:02.676483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] The token cache is being invalidate because project 1ea2e6ab7a7f40caa9540945310b9f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:02.676695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:02.677510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:02.679555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 910/1821] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:02 2022] DELETE /identity/v3/projects/1ea2e6ab7a7f40caa9540945310b9f50 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:02.680632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.681976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:02.684481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 912/1822] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:02 2022] DELETE /identity/v3/users/6f5e1d0a41b24b4aaa4ef81c0c64740e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:02.685993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523f534-7413-418f-9fc4-3e595cadfe66 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.686284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523f534-7413-418f-9fc4-3e595cadfe66 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.686564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523f534-7413-418f-9fc4-3e595cadfe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.712032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7523f534-7413-418f-9fc4-3e595cadfe66 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:02.713296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7523f534-7413-418f-9fc4-3e595cadfe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:02.780542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fdae9-265f-4c98-82f0-6a967876dd5b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:02.791901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 913/1823] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:02.793210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b594b7-cd15-4f6f-b256-91428673787d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.793498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b594b7-cd15-4f6f-b256-91428673787d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.793783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b594b7-cd15-4f6f-b256-91428673787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.817255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-19b594b7-cd15-4f6f-b256-91428673787d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:02.818511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-19b594b7-cd15-4f6f-b256-91428673787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:02.828688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 914/1824] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:02.833432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed2dfc-c056-4916-8df9-8154783048ba None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.833825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed2dfc-c056-4916-8df9-8154783048ba None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.834172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed2dfc-c056-4916-8df9-8154783048ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.858364 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-82ed2dfc-c056-4916-8df9-8154783048ba None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:02.859363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-82ed2dfc-c056-4916-8df9-8154783048ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:02.869137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 915/1825] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:02.872593 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed2dfc-c056-4916-8df9-8154783048ba None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.872593 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-82ed2dfc-c056-4916-8df9-8154783048ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:02.879657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4024589-2858-4e23-adbe-962fb514c738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:02.880299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024589-2858-4e23-adbe-962fb514c738 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.881500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024589-2858-4e23-adbe-962fb514c738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.882909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024589-2858-4e23-adbe-962fb514c738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.883728 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4024589-2858-4e23-adbe-962fb514c738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:02.886464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4024589-2858-4e23-adbe-962fb514c738 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:02.902384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 911/1826] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:02.903233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4024589-2858-4e23-adbe-962fb514c738 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.914589 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4024589-2858-4e23-adbe-962fb514c738 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:02.923528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb4161-f629-477a-bbdd-1998549959ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:02.923528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb4161-f629-477a-bbdd-1998549959ee admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.923528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb4161-f629-477a-bbdd-1998549959ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.923528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb4161-f629-477a-bbdd-1998549959ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.925502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb4161-f629-477a-bbdd-1998549959ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:02.925502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb4161-f629-477a-bbdd-1998549959ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:02.927502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb4161-f629-477a-bbdd-1998549959ee admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:02.940860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 912/1827] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:02.941922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb4161-f629-477a-bbdd-1998549959ee admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.951963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb4161-f629-477a-bbdd-1998549959ee admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:02.952122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed2dfc-c056-4916-8df9-8154783048ba None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:02.955616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1c28-3b53-40d3-bcd1-5121f28a7c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:02.956338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1c28-3b53-40d3-bcd1-5121f28a7c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.956635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1c28-3b53-40d3-bcd1-5121f28a7c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.956937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1c28-3b53-40d3-bcd1-5121f28a7c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.958413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571a395-7459-48bf-afb1-6ca27a1c8075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:02.959124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a395-7459-48bf-afb1-6ca27a1c8075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:02.959472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a395-7459-48bf-afb1-6ca27a1c8075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:02.959818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a395-7459-48bf-afb1-6ca27a1c8075 admin admin] PATH_INFO: `/v3/projects/0acde154f685411e8651c44427af849c/users/5ce6a7c898974deebe7e12ee73c6f373/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:02.967452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b1c28-3b53-40d3-bcd1-5121f28a7c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:02.969464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b1c28-3b53-40d3-bcd1-5121f28a7c8d service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:02.975989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571a395-7459-48bf-afb1-6ca27a1c8075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acde154f685411e8651c44427af849c, user_id=5ce6a7c898974deebe7e12ee73c6f373, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:02.978895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571a395-7459-48bf-afb1-6ca27a1c8075 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:02.983419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 916/1828] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:02.984543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1c28-3b53-40d3-bcd1-5121f28a7c8d service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:02.995538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 913/1829] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:02 2022] PUT /identity/v3/projects/0acde154f685411e8651c44427af849c/users/5ce6a7c898974deebe7e12ee73c6f373/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:02.995748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1c28-3b53-40d3-bcd1-5121f28a7c8d service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.008976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e0cc-5f3b-4ea2-9f68-15d4894edc18 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.009468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e0cc-5f3b-4ea2-9f68-15d4894edc18 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.009830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e0cc-5f3b-4ea2-9f68-15d4894edc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.046417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9100e0cc-5f3b-4ea2-9f68-15d4894edc18 None None] MFA Rules not processed for user `5ce6a7c898974deebe7e12ee73c6f373`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:03.047835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9100e0cc-5f3b-4ea2-9f68-15d4894edc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:03.066985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:03.124852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73be3a-0672-4954-8c51-a479fa133fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.126710 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73be3a-0672-4954-8c51-a479fa133fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.126997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73be3a-0672-4954-8c51-a479fa133fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.127354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73be3a-0672-4954-8c51-a479fa133fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.128109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73be3a-0672-4954-8c51-a479fa133fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.132205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73be3a-0672-4954-8c51-a479fa133fb3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.151574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:03.158100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 914/1830] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:03.163763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e0cc-5f3b-4ea2-9f68-15d4894edc18 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.170287 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 917/1831] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:02 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:03.174354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73be3a-0672-4954-8c51-a479fa133fb3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.179148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e0cc-5f3b-4ea2-9f68-15d4894edc18 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.259223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd71180-d835-454f-86ec-4d950ab95f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.260438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd71180-d835-454f-86ec-4d950ab95f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.260438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd71180-d835-454f-86ec-4d950ab95f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.260604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd71180-d835-454f-86ec-4d950ab95f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.261221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd71180-d835-454f-86ec-4d950ab95f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.263814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd71180-d835-454f-86ec-4d950ab95f8e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.308638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73be3a-0672-4954-8c51-a479fa133fb3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.313068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 915/1832] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:03 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:03.317763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd71180-d835-454f-86ec-4d950ab95f8e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.408740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd71180-d835-454f-86ec-4d950ab95f8e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.414556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55370fa2-36f9-4481-a077-136d9072e18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.415481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55370fa2-36f9-4481-a077-136d9072e18d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.415888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55370fa2-36f9-4481-a077-136d9072e18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.416260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55370fa2-36f9-4481-a077-136d9072e18d admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.417274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55370fa2-36f9-4481-a077-136d9072e18d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.420251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55370fa2-36f9-4481-a077-136d9072e18d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.423710 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67b501-24bd-4713-899d-caf78cf6959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.424354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67b501-24bd-4713-899d-caf78cf6959f admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.425286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67b501-24bd-4713-899d-caf78cf6959f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.426136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67b501-24bd-4713-899d-caf78cf6959f admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.426913 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67b501-24bd-4713-899d-caf78cf6959f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.429288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67b501-24bd-4713-899d-caf78cf6959f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.452250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 916/1833] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:03 2022] POST /identity/v3/users => generated 301 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:03.456529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55370fa2-36f9-4481-a077-136d9072e18d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.468256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 918/1834] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:03 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:03.473185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67b501-24bd-4713-899d-caf78cf6959f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.476486 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55370fa2-36f9-4481-a077-136d9072e18d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.485045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218a68c-9748-4e0d-a56a-e3d8ef0da394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.485859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218a68c-9748-4e0d-a56a-e3d8ef0da394 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.486532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218a68c-9748-4e0d-a56a-e3d8ef0da394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.487548 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218a68c-9748-4e0d-a56a-e3d8ef0da394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.488773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218a68c-9748-4e0d-a56a-e3d8ef0da394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.490831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218a68c-9748-4e0d-a56a-e3d8ef0da394 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.499339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67b501-24bd-4713-899d-caf78cf6959f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.506007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d690-d5c8-45bb-97e1-b82d75f708a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.506337 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d690-d5c8-45bb-97e1-b82d75f708a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.508358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d690-d5c8-45bb-97e1-b82d75f708a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.508358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d690-d5c8-45bb-97e1-b82d75f708a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.509904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6d690-d5c8-45bb-97e1-b82d75f708a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.510531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6d690-d5c8-45bb-97e1-b82d75f708a5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.511331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 917/1835] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:03.517155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218a68c-9748-4e0d-a56a-e3d8ef0da394 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.533796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218a68c-9748-4e0d-a56a-e3d8ef0da394 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.539616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 919/1836] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:03.541308 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d690-d5c8-45bb-97e1-b82d75f708a5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.544025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a445abc-31b8-4cb4-b9c4-b3f5806df103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.545006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a445abc-31b8-4cb4-b9c4-b3f5806df103 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.546552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a445abc-31b8-4cb4-b9c4-b3f5806df103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.547192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a445abc-31b8-4cb4-b9c4-b3f5806df103 admin admin] PATH_INFO: `/v3/projects/23bd86dd7bdd4c978caa59856f2f0ef5/users/a3322b19782a4316ba3cd265c551b99b/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.554654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d690-d5c8-45bb-97e1-b82d75f708a5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.559632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7edd1f-5e39-4a9a-bc96-1b95ebc9588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.560249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7edd1f-5e39-4a9a-bc96-1b95ebc9588e admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.560609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7edd1f-5e39-4a9a-bc96-1b95ebc9588e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.560897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7edd1f-5e39-4a9a-bc96-1b95ebc9588e admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.561538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7edd1f-5e39-4a9a-bc96-1b95ebc9588e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.563736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7edd1f-5e39-4a9a-bc96-1b95ebc9588e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.572712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a445abc-31b8-4cb4-b9c4-b3f5806df103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bd86dd7bdd4c978caa59856f2f0ef5, user_id=a3322b19782a4316ba3cd265c551b99b, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.578858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 920/1837] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:03.583095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a445abc-31b8-4cb4-b9c4-b3f5806df103 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.585870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:03.590261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7edd1f-5e39-4a9a-bc96-1b95ebc9588e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.615799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7edd1f-5e39-4a9a-bc96-1b95ebc9588e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.618877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 918/1838] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:03 2022] PUT /identity/v3/projects/23bd86dd7bdd4c978caa59856f2f0ef5/users/a3322b19782a4316ba3cd265c551b99b/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:03.622658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a445abc-31b8-4cb4-b9c4-b3f5806df103 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.713960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a445abc-31b8-4cb4-b9c4-b3f5806df103 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.714279 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1698828-3077-40d1-93f8-7dbfbd505ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.715154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698828-3077-40d1-93f8-7dbfbd505ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.715761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698828-3077-40d1-93f8-7dbfbd505ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.716605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698828-3077-40d1-93f8-7dbfbd505ee8 admin admin] PATH_INFO: `/v3/projects/9e70af3f7f5c46609b1c5fab565dea71/users/07f112029e094847a340bfc07c9d3157/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.719747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee5726-56bb-40f9-b08e-71acc05c42b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.725340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee5726-56bb-40f9-b08e-71acc05c42b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.725340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee5726-56bb-40f9-b08e-71acc05c42b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.725340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee5726-56bb-40f9-b08e-71acc05c42b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.725340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee5726-56bb-40f9-b08e-71acc05c42b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.725340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee5726-56bb-40f9-b08e-71acc05c42b1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.740007 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 919/1839] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:03.741577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee5726-56bb-40f9-b08e-71acc05c42b1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.751335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:03.755897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1698828-3077-40d1-93f8-7dbfbd505ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e70af3f7f5c46609b1c5fab565dea71, user_id=07f112029e094847a340bfc07c9d3157, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.758780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee5726-56bb-40f9-b08e-71acc05c42b1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:03.759932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1698828-3077-40d1-93f8-7dbfbd505ee8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.765682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c56e-49ea-4840-b12e-d760ff3ad08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:03.766887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c56e-49ea-4840-b12e-d760ff3ad08a admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.767371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c56e-49ea-4840-b12e-d760ff3ad08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.767851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c56e-49ea-4840-b12e-d760ff3ad08a admin admin] PATH_INFO: `/v3/projects/23bd86dd7bdd4c978caa59856f2f0ef5/users/a3322b19782a4316ba3cd265c551b99b/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.770636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233c56e-49ea-4840-b12e-d760ff3ad08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bd86dd7bdd4c978caa59856f2f0ef5, user_id=a3322b19782a4316ba3cd265c551b99b, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:03.774384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233c56e-49ea-4840-b12e-d760ff3ad08a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:03.791595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 921/1840] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:03 2022] PUT /identity/v3/projects/9e70af3f7f5c46609b1c5fab565dea71/users/07f112029e094847a340bfc07c9d3157/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:03.803782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67832b7-5941-4485-995e-b4c5e5e3e363 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.804204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67832b7-5941-4485-995e-b4c5e5e3e363 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.804635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67832b7-5941-4485-995e-b4c5e5e3e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.806418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 920/1841] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:03 2022] PUT /identity/v3/projects/23bd86dd7bdd4c978caa59856f2f0ef5/users/a3322b19782a4316ba3cd265c551b99b/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:03.817645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b4d4-37b4-4b84-a034-f73f2e6c2b01 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:03.817943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b4d4-37b4-4b84-a034-f73f2e6c2b01 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:03.819195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b4d4-37b4-4b84-a034-f73f2e6c2b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:03.842494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f67832b7-5941-4485-995e-b4c5e5e3e363 None None] MFA Rules not processed for user `07f112029e094847a340bfc07c9d3157`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:03.844166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f67832b7-5941-4485-995e-b4c5e5e3e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:03.856391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5d16b4d4-37b4-4b84-a034-f73f2e6c2b01 None None] MFA Rules not processed for user `a3322b19782a4316ba3cd265c551b99b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:03.857724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d16b4d4-37b4-4b84-a034-f73f2e6c2b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:03.967032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 922/1842] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:03.967724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 921/1843] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:03.973640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67832b7-5941-4485-995e-b4c5e5e3e363 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.980616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b4d4-37b4-4b84-a034-f73f2e6c2b01 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:03.986813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d16b4d4-37b4-4b84-a034-f73f2e6c2b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:04.068075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67832b7-5941-4485-995e-b4c5e5e3e363 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:04.073423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f579d-8023-4618-8ea2-6a69f4db81eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:04.074055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f579d-8023-4618-8ea2-6a69f4db81eb admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:04.074385 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f579d-8023-4618-8ea2-6a69f4db81eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:04.074738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f579d-8023-4618-8ea2-6a69f4db81eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:04.075455 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f579d-8023-4618-8ea2-6a69f4db81eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:04.078198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f579d-8023-4618-8ea2-6a69f4db81eb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:04.132404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 923/1844] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:03 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:04.133854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f579d-8023-4618-8ea2-6a69f4db81eb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:04.138079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cb4f579d-8023-4618-8ea2-6a69f4db81eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:04.155483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b4d4-37b4-4b84-a034-f73f2e6c2b01 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:04.184644 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:04.278784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef124a9d-439b-4c3f-a6cc-799a61b8c246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:04.279250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef124a9d-439b-4c3f-a6cc-799a61b8c246 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:04.280022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef124a9d-439b-4c3f-a6cc-799a61b8c246 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:04.280022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef124a9d-439b-4c3f-a6cc-799a61b8c246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:04.282985 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f579d-8023-4618-8ea2-6a69f4db81eb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:04.294276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:04.295220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:04.295616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:04.295989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] PATH_INFO: `/v3/projects/96eb0fe0c0de4db0ba445a7ec1ce7ef9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:04.300162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96eb0fe0c0de4db0ba445a7ec1ce7ef9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:04.309462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:04.330105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:04.412753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96eb0fe0c0de4db0ba445a7ec1ce7ef9', 'request_id': 'req-919f1601-5d77-47cf-9654-a65f50ec5a89'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.413375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef124a9d-439b-4c3f-a6cc-799a61b8c246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:04.415531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef124a9d-439b-4c3f-a6cc-799a61b8c246 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:04.425417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96eb0fe0c0de4db0ba445a7ec1ce7ef9', 'request_id': 'req-919f1601-5d77-47cf-9654-a65f50ec5a89'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.431584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 922/1845] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:04.432474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef124a9d-439b-4c3f-a6cc-799a61b8c246 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:04.445059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef124a9d-439b-4c3f-a6cc-799a61b8c246 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:04.459685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96eb0fe0c0de4db0ba445a7ec1ce7ef9', 'request_id': 'req-919f1601-5d77-47cf-9654-a65f50ec5a89'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.493463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] The token cache is being invalidate because project 96eb0fe0c0de4db0ba445a7ec1ce7ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:04.493769 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.494554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.496435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 924/1846] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:04 2022] DELETE /identity/v3/projects/96eb0fe0c0de4db0ba445a7ec1ce7ef9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:04.500542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:04.502170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:04.552298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc79f62-0307-4dbd-8e21-5e364f292d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:04.553948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc79f62-0307-4dbd-8e21-5e364f292d78 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:04.554722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc79f62-0307-4dbd-8e21-5e364f292d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:04.555859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc79f62-0307-4dbd-8e21-5e364f292d78 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:04.556822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc79f62-0307-4dbd-8e21-5e364f292d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:04.559931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc79f62-0307-4dbd-8e21-5e364f292d78 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:04.595768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f1601-5d77-47cf-9654-a65f50ec5a89 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:04.604198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 923/1847] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:04 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:04.604702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:04.605168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc79f62-0307-4dbd-8e21-5e364f292d78 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:04.605309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:04.605555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:04.605773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] PATH_INFO: `/v3/users/211bed11516f47a1a7ad5dfbb01d4953` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:04.606894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cdc79f62-0307-4dbd-8e21-5e364f292d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:04.607019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211bed11516f47a1a7ad5dfbb01d4953)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:04.609166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:04.629564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc79f62-0307-4dbd-8e21-5e364f292d78 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:04.646528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50081223-f1b2-4a56-a8e0-ef155344ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:04.647066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50081223-f1b2-4a56-a8e0-ef155344ac32 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:04.647350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50081223-f1b2-4a56-a8e0-ef155344ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:04.647630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50081223-f1b2-4a56-a8e0-ef155344ac32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:04.648483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50081223-f1b2-4a56-a8e0-ef155344ac32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:04.650516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50081223-f1b2-4a56-a8e0-ef155344ac32 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:04.665042 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 924/1848] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:04.670566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50081223-f1b2-4a56-a8e0-ef155344ac32 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:04.688265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211bed11516f47a1a7ad5dfbb01d4953'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.689085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211bed11516f47a1a7ad5dfbb01d4953'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.692747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50081223-f1b2-4a56-a8e0-ef155344ac32 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:04.698788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7decd0-c64c-43c4-bd27-90bf1bbb7a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:04.699072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211bed11516f47a1a7ad5dfbb01d4953'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.699630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7decd0-c64c-43c4-bd27-90bf1bbb7a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:04.700131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7decd0-c64c-43c4-bd27-90bf1bbb7a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:04.700602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7decd0-c64c-43c4-bd27-90bf1bbb7a91 admin admin] PATH_INFO: `/v3/projects/2827ca13ab6b4e94ba4caed2d59b54c7/users/4e87f11065d54e28a05c3651fdde22ec/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:04.707368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211bed11516f47a1a7ad5dfbb01d4953'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.719761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7decd0-c64c-43c4-bd27-90bf1bbb7a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2827ca13ab6b4e94ba4caed2d59b54c7, user_id=4e87f11065d54e28a05c3651fdde22ec, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:04.723197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7decd0-c64c-43c4-bd27-90bf1bbb7a91 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:04.729245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211bed11516f47a1a7ad5dfbb01d4953'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.747070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 925/1849] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:04 2022] PUT /identity/v3/projects/2827ca13ab6b4e94ba4caed2d59b54c7/users/4e87f11065d54e28a05c3651fdde22ec/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:04.749330 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7decd0-c64c-43c4-bd27-90bf1bbb7a91 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:04.751573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 925/1850] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:04 2022] DELETE /identity/v3/users/211bed11516f47a1a7ad5dfbb01d4953 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:04.752262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4e7decd0-c64c-43c4-bd27-90bf1bbb7a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:04.752629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:04.755401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:04.776384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:04.786359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:04.836767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7decd0-c64c-43c4-bd27-90bf1bbb7a91 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:04.850644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1b0f-ad56-483e-8322-c760f80e4025 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:04.851235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:04.851904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:04.852289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:04.852808 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] PATH_INFO: `/v3/users/5ce6a7c898974deebe7e12ee73c6f373` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:04.854016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce6a7c898974deebe7e12ee73c6f373)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:04.856027 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:04.861687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e0430-9b63-44ed-88ef-13e136e36394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:04.863493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e0430-9b63-44ed-88ef-13e136e36394 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:04.864576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e0430-9b63-44ed-88ef-13e136e36394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:04.865228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e0430-9b63-44ed-88ef-13e136e36394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:04.866024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e0430-9b63-44ed-88ef-13e136e36394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:04.868308 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e0430-9b63-44ed-88ef-13e136e36394 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:04.888080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 926/1851] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:04.889325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e0430-9b63-44ed-88ef-13e136e36394 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:04.891424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d52e0430-9b63-44ed-88ef-13e136e36394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:04.907144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e0430-9b63-44ed-88ef-13e136e36394 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:04.914349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:04.914767 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:04.915458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:04.915638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] PATH_INFO: `/v3/users/d256e317788d400a97a0035522fc4e9f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:04.917109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d256e317788d400a97a0035522fc4e9f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:04.920076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:04.935870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce6a7c898974deebe7e12ee73c6f373'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.938575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce6a7c898974deebe7e12ee73c6f373'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.949744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce6a7c898974deebe7e12ee73c6f373'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.967240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce6a7c898974deebe7e12ee73c6f373'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.986590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce6a7c898974deebe7e12ee73c6f373'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.998462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 926/1852] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:04 2022] DELETE /identity/v3/users/5ce6a7c898974deebe7e12ee73c6f373 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:04.998913 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd256e317788d400a97a0035522fc4e9f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:04.999295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:04.999763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd256e317788d400a97a0035522fc4e9f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:05.000856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:05.011560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd256e317788d400a97a0035522fc4e9f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:05.023105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd256e317788d400a97a0035522fc4e9f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:05.100523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc034-7a50-4e80-92dd-7bbf3beeeb83 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:05.107909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-073b3ec9-6c5b-4c89-9bba-ec8387a73f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd256e317788d400a97a0035522fc4e9f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:05.110690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05b2a3-4a7e-4cb5-8943-01adf46f0704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:05.110850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05b2a3-4a7e-4cb5-8943-01adf46f0704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.111019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05b2a3-4a7e-4cb5-8943-01adf46f0704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.111296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05b2a3-4a7e-4cb5-8943-01adf46f0704 admin admin] PATH_INFO: `/v3/projects/2827ca13ab6b4e94ba4caed2d59b54c7/users/4e87f11065d54e28a05c3651fdde22ec/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.114784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05b2a3-4a7e-4cb5-8943-01adf46f0704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2827ca13ab6b4e94ba4caed2d59b54c7, user_id=4e87f11065d54e28a05c3651fdde22ec, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:05.118275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05b2a3-4a7e-4cb5-8943-01adf46f0704 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:05.125775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 927/1853] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:04 2022] DELETE /identity/v3/users/d256e317788d400a97a0035522fc4e9f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:05.131295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd71c1e-b2b9-486d-a0e5-5b7a56e7dea4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.133293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd71c1e-b2b9-486d-a0e5-5b7a56e7dea4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.133594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd71c1e-b2b9-486d-a0e5-5b7a56e7dea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.143701 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 927/1854] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:04 2022] PUT /identity/v3/projects/2827ca13ab6b4e94ba4caed2d59b54c7/users/4e87f11065d54e28a05c3651fdde22ec/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:05.153778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaee07-1dd0-4a99-9aae-1ee326085beb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.154079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaee07-1dd0-4a99-9aae-1ee326085beb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.154350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaee07-1dd0-4a99-9aae-1ee326085beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.173250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1cd71c1e-b2b9-486d-a0e5-5b7a56e7dea4 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:05.175672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1cd71c1e-b2b9-486d-a0e5-5b7a56e7dea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:05.200892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c9aaee07-1dd0-4a99-9aae-1ee326085beb None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:05.202874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c9aaee07-1dd0-4a99-9aae-1ee326085beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:05.245408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:05.262390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 928/1855] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:05.264075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bd036-0d7c-4489-94f7-d13f8473fd93 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.264664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bd036-0d7c-4489-94f7-d13f8473fd93 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.264795 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bd036-0d7c-4489-94f7-d13f8473fd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.304247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 928/1856] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:05.304471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-780bd036-0d7c-4489-94f7-d13f8473fd93 None None] MFA Rules not processed for user `4e87f11065d54e28a05c3651fdde22ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:05.304579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaee07-1dd0-4a99-9aae-1ee326085beb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:05.304668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-780bd036-0d7c-4489-94f7-d13f8473fd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:05.304759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c9aaee07-1dd0-4a99-9aae-1ee326085beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:05.326704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:05.389410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaee07-1dd0-4a99-9aae-1ee326085beb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:05.395060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecae5e-0ae4-40bd-ac34-554c4f632120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:05.399346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecae5e-0ae4-40bd-ac34-554c4f632120 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.399346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecae5e-0ae4-40bd-ac34-554c4f632120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.399346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecae5e-0ae4-40bd-ac34-554c4f632120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.402660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 929/1857] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:05.403328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bd036-0d7c-4489-94f7-d13f8473fd93 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:05.417616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecae5e-0ae4-40bd-ac34-554c4f632120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:05.420773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecae5e-0ae4-40bd-ac34-554c4f632120 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:05.421344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bd036-0d7c-4489-94f7-d13f8473fd93 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:05.428501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e301-be7b-452f-bd18-2ac619d69b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:05.429145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e301-be7b-452f-bd18-2ac619d69b9b service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.429416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e301-be7b-452f-bd18-2ac619d69b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.429692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e301-be7b-452f-bd18-2ac619d69b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.439757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 929/1858] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:05.441106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370e301-be7b-452f-bd18-2ac619d69b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:05.442574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370e301-be7b-452f-bd18-2ac619d69b9b service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:05.445455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecae5e-0ae4-40bd-ac34-554c4f632120 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:05.447136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-93ecae5e-0ae4-40bd-ac34-554c4f632120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:05.453717 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 930/1859] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:05.454383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e301-be7b-452f-bd18-2ac619d69b9b service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:05.456199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4370e301-be7b-452f-bd18-2ac619d69b9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:05.462947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecae5e-0ae4-40bd-ac34-554c4f632120 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:05.480521 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:05.481171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.481449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.481727 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] PATH_INFO: `/v3/projects/ddb6d6a3e3224a1988e80ee8b61cf8f0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.482870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb6d6a3e3224a1988e80ee8b61cf8f0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:05.484965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:05.558677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e301-be7b-452f-bd18-2ac619d69b9b service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:05.567774 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb6d6a3e3224a1988e80ee8b61cf8f0', 'request_id': 'req-4d9d5617-f9ff-4817-9e19-7e9101a4c704'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:05.579494 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb6d6a3e3224a1988e80ee8b61cf8f0', 'request_id': 'req-4d9d5617-f9ff-4817-9e19-7e9101a4c704'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:05.611216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb6d6a3e3224a1988e80ee8b61cf8f0', 'request_id': 'req-4d9d5617-f9ff-4817-9e19-7e9101a4c704'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:05.631402 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] The token cache is being invalidate because project ddb6d6a3e3224a1988e80ee8b61cf8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:05.631698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:05.633204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d9d5617-f9ff-4817-9e19-7e9101a4c704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:05.636143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 930/1860] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:05 2022] DELETE /identity/v3/projects/ddb6d6a3e3224a1988e80ee8b61cf8f0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:05.642706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723931c-5e10-4592-b770-8ecc77e66504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:05.643880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff3f6-9414-418a-af48-0974bc058f4d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.644171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff3f6-9414-418a-af48-0974bc058f4d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.644499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff3f6-9414-418a-af48-0974bc058f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.645013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723931c-5e10-4592-b770-8ecc77e66504 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.645715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723931c-5e10-4592-b770-8ecc77e66504 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.646099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723931c-5e10-4592-b770-8ecc77e66504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.649613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b723931c-5e10-4592-b770-8ecc77e66504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:05.685830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-08bff3f6-9414-418a-af48-0974bc058f4d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:05.688066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-08bff3f6-9414-418a-af48-0974bc058f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:05.767630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723931c-5e10-4592-b770-8ecc77e66504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:05.772194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723931c-5e10-4592-b770-8ecc77e66504 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:05.788652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 931/1861] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:05.796612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b77d4-d385-4039-8aee-012c3dcce6ef None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.796977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b77d4-d385-4039-8aee-012c3dcce6ef None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.797324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b77d4-d385-4039-8aee-012c3dcce6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.803667 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 931/1862] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:05.816373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:05.856413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5d5b77d4-d385-4039-8aee-012c3dcce6ef None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:05.861779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d5b77d4-d385-4039-8aee-012c3dcce6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:05.885463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 932/1863] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:05.889527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723931c-5e10-4592-b770-8ecc77e66504 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:05.895712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:05.905449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723931c-5e10-4592-b770-8ecc77e66504 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:05.916242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f651e-4355-4c3e-8b66-a1603c54bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:05.917145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f651e-4355-4c3e-8b66-a1603c54bcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.917532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f651e-4355-4c3e-8b66-a1603c54bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.918089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f651e-4355-4c3e-8b66-a1603c54bcd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.918881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f651e-4355-4c3e-8b66-a1603c54bcd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:05.919381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f651e-4355-4c3e-8b66-a1603c54bcd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:05.921685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f651e-4355-4c3e-8b66-a1603c54bcd7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:05.946516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 932/1864] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:05.951314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b77d4-d385-4039-8aee-012c3dcce6ef None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:05.967221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b77d4-d385-4039-8aee-012c3dcce6ef None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:05.975918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104249df-0932-43a9-896c-03bfaa1ae555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:05.977196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104249df-0932-43a9-896c-03bfaa1ae555 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:05.977655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104249df-0932-43a9-896c-03bfaa1ae555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:05.978082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104249df-0932-43a9-896c-03bfaa1ae555 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:05.978899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104249df-0932-43a9-896c-03bfaa1ae555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:05.981025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104249df-0932-43a9-896c-03bfaa1ae555 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:06.016385 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f651e-4355-4c3e-8b66-a1603c54bcd7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:06.019803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4a3f651e-4355-4c3e-8b66-a1603c54bcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:06.041780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 933/1865] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:05 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:06.043042 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104249df-0932-43a9-896c-03bfaa1ae555 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:06.049751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f651e-4355-4c3e-8b66-a1603c54bcd7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:06.192661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104249df-0932-43a9-896c-03bfaa1ae555 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:06.199100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce333f3-e697-4420-b781-944b0a35d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:06.201158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce333f3-e697-4420-b781-944b0a35d7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:06.201700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce333f3-e697-4420-b781-944b0a35d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:06.201980 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce333f3-e697-4420-b781-944b0a35d7f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:06.203112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce333f3-e697-4420-b781-944b0a35d7f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:06.206340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce333f3-e697-4420-b781-944b0a35d7f1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:06.210145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:06.211229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:06.211351 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:06.211807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] PATH_INFO: `/v3/projects/656784114eee484a8c5235d85007245a` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:06.213206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656784114eee484a8c5235d85007245a)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:06.215634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:06.240295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 934/1866] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:06 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:06.246003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce333f3-e697-4420-b781-944b0a35d7f1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:06.276664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce333f3-e697-4420-b781-944b0a35d7f1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:06.304518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656784114eee484a8c5235d85007245a', 'request_id': 'req-8d05005a-2d2f-4830-ba92-d821d9275237'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.312792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656784114eee484a8c5235d85007245a', 'request_id': 'req-8d05005a-2d2f-4830-ba92-d821d9275237'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.349219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656784114eee484a8c5235d85007245a', 'request_id': 'req-8d05005a-2d2f-4830-ba92-d821d9275237'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.376632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] The token cache is being invalidate because project 656784114eee484a8c5235d85007245a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:06.377001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.378234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.380229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 933/1867] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:06 2022] DELETE /identity/v3/projects/656784114eee484a8c5235d85007245a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:06.384778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:06.386502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:06.391851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ab3e1-197e-43bb-b634-34f1c6cbe84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:06.396604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ab3e1-197e-43bb-b634-34f1c6cbe84c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:06.396984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ab3e1-197e-43bb-b634-34f1c6cbe84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:06.397263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ab3e1-197e-43bb-b634-34f1c6cbe84c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:06.397975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ab3e1-197e-43bb-b634-34f1c6cbe84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:06.401657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ab3e1-197e-43bb-b634-34f1c6cbe84c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:06.419051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05005a-2d2f-4830-ba92-d821d9275237 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:06.425473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:06.426725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:06.427228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:06.427762 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] PATH_INFO: `/v3/projects/0acde154f685411e8651c44427af849c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:06.429284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acde154f685411e8651c44427af849c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:06.432277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:06.434127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 935/1868] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:06.435002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ab3e1-197e-43bb-b634-34f1c6cbe84c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:06.439525 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5e8ab3e1-197e-43bb-b634-34f1c6cbe84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:06.467666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ab3e1-197e-43bb-b634-34f1c6cbe84c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:06.484580 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:06.487455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:06.489701 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:06.491190 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] PATH_INFO: `/v3/users/cf4f039d58aa48039be61ae85f0a2670` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:06.500053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4f039d58aa48039be61ae85f0a2670)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:06.504766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:06.530619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acde154f685411e8651c44427af849c', 'request_id': 'req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.539064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acde154f685411e8651c44427af849c', 'request_id': 'req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.547012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acde154f685411e8651c44427af849c', 'request_id': 'req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.581798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] The token cache is being invalidate because project 0acde154f685411e8651c44427af849c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:06.583417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.584285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.586616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 934/1869] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:06 2022] DELETE /identity/v3/projects/0acde154f685411e8651c44427af849c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:06.587445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:06.592006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:06.596889 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:06.615709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4f039d58aa48039be61ae85f0a2670'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.617751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4f039d58aa48039be61ae85f0a2670'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.638101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4f039d58aa48039be61ae85f0a2670'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.645820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:06.704435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4f039d58aa48039be61ae85f0a2670'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.733190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc05ee4-1831-4778-bf1f-90e1516ac4ba admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:06.739966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101d429-c445-44b8-82ce-ab6b50017ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:06.740668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d429-c445-44b8-82ce-ab6b50017ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:06.741051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d429-c445-44b8-82ce-ab6b50017ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:06.741310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d429-c445-44b8-82ce-ab6b50017ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:06.742442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101d429-c445-44b8-82ce-ab6b50017ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:06.745267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101d429-c445-44b8-82ce-ab6b50017ce3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:06.747097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4f039d58aa48039be61ae85f0a2670'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:06.760613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 935/1870] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:06.761721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101d429-c445-44b8-82ce-ab6b50017ce3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:06.763404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 936/1871] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:06 2022] DELETE /identity/v3/users/cf4f039d58aa48039be61ae85f0a2670 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:06.765417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5101d429-c445-44b8-82ce-ab6b50017ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:06.767165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:06.771752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:06.808915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101d429-c445-44b8-82ce-ab6b50017ce3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:06.873110 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435dec8-2a3f-48b3-9306-03d8fe45997a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:06.887931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:06.891024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:06.891378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:06.891781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] PATH_INFO: `/v3/users/07f112029e094847a340bfc07c9d3157` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:06.898097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f112029e094847a340bfc07c9d3157)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:06.903708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:06.959271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:06.960177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:06.960539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:06.961192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] PATH_INFO: `/v3/users/a3322b19782a4316ba3cd265c551b99b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:06.965838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3322b19782a4316ba3cd265c551b99b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:06.968785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:07.017545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f112029e094847a340bfc07c9d3157'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.018693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f112029e094847a340bfc07c9d3157'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.035395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f112029e094847a340bfc07c9d3157'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.061424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f112029e094847a340bfc07c9d3157'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.076294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f112029e094847a340bfc07c9d3157'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.089892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 937/1872] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:06 2022] DELETE /identity/v3/users/07f112029e094847a340bfc07c9d3157 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:07.090677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:07.092058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:07.092882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3322b19782a4316ba3cd265c551b99b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.093699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3322b19782a4316ba3cd265c551b99b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.110019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3322b19782a4316ba3cd265c551b99b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.132919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3322b19782a4316ba3cd265c551b99b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.190643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d4c4f684-307e-4936-a707-22cf70743fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3322b19782a4316ba3cd265c551b99b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.204721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 936/1873] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:06 2022] DELETE /identity/v3/users/a3322b19782a4316ba3cd265c551b99b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:07.209061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce929b-af05-409c-894e-4a6d9835a2ae None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.209466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce929b-af05-409c-894e-4a6d9835a2ae None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.209956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce929b-af05-409c-894e-4a6d9835a2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:07.210750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:07.234268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87188539-9b7e-45d8-bf88-781afdf27bc1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:07.257614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b6ce929b-af05-409c-894e-4a6d9835a2ae None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:07.263778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b6ce929b-af05-409c-894e-4a6d9835a2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:07.281745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:07.367795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf06a6-8bae-433b-ae4e-238f51177a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:07.368861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf06a6-8bae-433b-ae4e-238f51177a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.369311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf06a6-8bae-433b-ae4e-238f51177a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.369803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf06a6-8bae-433b-ae4e-238f51177a2b admin admin] PATH_INFO: `/v3/projects/67a8e129d3a640daa3f2c2c257768d04/users/e49d237f228d4b0e8d516a2bffb27242/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:07.374170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 937/1874] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:07.375431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8dc1d-b8f5-4f01-8504-d7dc984d13a7 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.375825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8dc1d-b8f5-4f01-8504-d7dc984d13a7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.376229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8dc1d-b8f5-4f01-8504-d7dc984d13a7 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:07.379180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 938/1875] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:09:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:09:07.389169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf06a6-8bae-433b-ae4e-238f51177a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a8e129d3a640daa3f2c2c257768d04, user_id=e49d237f228d4b0e8d516a2bffb27242, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:07.392715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf06a6-8bae-433b-ae4e-238f51177a2b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:07.394940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe86910-9e88-424d-9a7e-09692758a201 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.395330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe86910-9e88-424d-9a7e-09692758a201 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.395713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe86910-9e88-424d-9a7e-09692758a201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:07.412178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 938/1876] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:07 2022] PUT /identity/v3/projects/67a8e129d3a640daa3f2c2c257768d04/users/e49d237f228d4b0e8d516a2bffb27242/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:07.413310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf06a6-8bae-433b-ae4e-238f51177a2b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:07.415768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cedf06a6-8bae-433b-ae4e-238f51177a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:07.422177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5fe86910-9e88-424d-9a7e-09692758a201 None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:07.423907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5fe86910-9e88-424d-9a7e-09692758a201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:07.509081 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf06a6-8bae-433b-ae4e-238f51177a2b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:07.513663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4616d-fa69-4142-9108-64e7dcb7c69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:07.514550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4616d-fa69-4142-9108-64e7dcb7c69f service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.514673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4616d-fa69-4142-9108-64e7dcb7c69f service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.515001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4616d-fa69-4142-9108-64e7dcb7c69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:07.568059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 939/1877] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:07.570077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c863f-fbae-4e68-9ec2-07be275cd6d5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.570356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c863f-fbae-4e68-9ec2-07be275cd6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.570839 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c863f-fbae-4e68-9ec2-07be275cd6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:07.614081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-379c863f-fbae-4e68-9ec2-07be275cd6d5 None None] MFA Rules not processed for user `e49d237f228d4b0e8d516a2bffb27242`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:07.615367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-379c863f-fbae-4e68-9ec2-07be275cd6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:07.637872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4616d-fa69-4142-9108-64e7dcb7c69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:07.639263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4616d-fa69-4142-9108-64e7dcb7c69f service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:07.658113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 939/1878] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:07.659018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4616d-fa69-4142-9108-64e7dcb7c69f service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:07.660438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-96c4616d-fa69-4142-9108-64e7dcb7c69f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:07.674230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4616d-fa69-4142-9108-64e7dcb7c69f service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:07.680512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:07.681743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.682162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.682544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] PATH_INFO: `/v3/projects/930657e434754c61b700e6906bcf0efc` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:07.684112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930657e434754c61b700e6906bcf0efc)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:07.686295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:07.705503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 940/1879] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:07.706982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c863f-fbae-4e68-9ec2-07be275cd6d5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:07.708682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-379c863f-fbae-4e68-9ec2-07be275cd6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:07.729233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c863f-fbae-4e68-9ec2-07be275cd6d5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:07.729913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:07.736179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02fc76-ad7e-4aac-8a7a-d51100adf41a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:07.737531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fc76-ad7e-4aac-8a7a-d51100adf41a service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.738002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fc76-ad7e-4aac-8a7a-d51100adf41a service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.738344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fc76-ad7e-4aac-8a7a-d51100adf41a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:07.749314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02fc76-ad7e-4aac-8a7a-d51100adf41a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:07.750853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02fc76-ad7e-4aac-8a7a-d51100adf41a service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:07.756931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930657e434754c61b700e6906bcf0efc', 'request_id': 'req-19e3e025-dd47-4f1d-ae4c-768a84e18075'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.765964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930657e434754c61b700e6906bcf0efc', 'request_id': 'req-19e3e025-dd47-4f1d-ae4c-768a84e18075'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.768561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 941/1880] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:07.771964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02fc76-ad7e-4aac-8a7a-d51100adf41a service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:07.774170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fa02fc76-ad7e-4aac-8a7a-d51100adf41a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:07.783173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930657e434754c61b700e6906bcf0efc', 'request_id': 'req-19e3e025-dd47-4f1d-ae4c-768a84e18075'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.813257 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02fc76-ad7e-4aac-8a7a-d51100adf41a service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:07.827928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] The token cache is being invalidate because project 930657e434754c61b700e6906bcf0efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:07.828343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.829207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:07.832374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 940/1881] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:07 2022] DELETE /identity/v3/projects/930657e434754c61b700e6906bcf0efc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:07.838173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:07.842017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:07.885254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:07.924245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9898c7c-1f8a-49ba-967e-d958c5508930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:07.925779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9898c7c-1f8a-49ba-967e-d958c5508930 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.926230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9898c7c-1f8a-49ba-967e-d958c5508930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.926658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9898c7c-1f8a-49ba-967e-d958c5508930 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:07.927444 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9898c7c-1f8a-49ba-967e-d958c5508930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:07.929979 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9898c7c-1f8a-49ba-967e-d958c5508930 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:07.944235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3e025-dd47-4f1d-ae4c-768a84e18075 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:07.956505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:07.959080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.959567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.960184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] PATH_INFO: `/v3/projects/23bd86dd7bdd4c978caa59856f2f0ef5` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:07.963200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23bd86dd7bdd4c978caa59856f2f0ef5)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:07.965751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:07.980564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 942/1882] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:07 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:07.980564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa38df-b03e-4923-87d3-606bbe949b44 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:07.980564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa38df-b03e-4923-87d3-606bbe949b44 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:07.980564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa38df-b03e-4923-87d3-606bbe949b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.014574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e5fa38df-b03e-4923-87d3-606bbe949b44 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:08.016641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e5fa38df-b03e-4923-87d3-606bbe949b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:08.075128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23bd86dd7bdd4c978caa59856f2f0ef5', 'request_id': 'req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.084448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23bd86dd7bdd4c978caa59856f2f0ef5', 'request_id': 'req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.110542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23bd86dd7bdd4c978caa59856f2f0ef5', 'request_id': 'req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.126058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] The token cache is being invalidate because project 23bd86dd7bdd4c978caa59856f2f0ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:08.126436 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.127159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.128933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 941/1883] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:07 2022] DELETE /identity/v3/projects/23bd86dd7bdd4c978caa59856f2f0ef5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:08.129676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:08.136540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:08.136699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 943/1884] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:08.138001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa38df-b03e-4923-87d3-606bbe949b44 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:08.139439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e5fa38df-b03e-4923-87d3-606bbe949b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:08.158499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa38df-b03e-4923-87d3-606bbe949b44 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:08.222783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:08.262805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf395-1fc9-4ab8-b2fd-8c8fb0b738f8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:08.270763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369acc3f-ea12-425f-98f2-448b2c11ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:08.271836 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369acc3f-ea12-425f-98f2-448b2c11ed04 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.272394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369acc3f-ea12-425f-98f2-448b2c11ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.272532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:08.273001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369acc3f-ea12-425f-98f2-448b2c11ed04 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.273349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.273704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.274048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] PATH_INFO: `/v3/projects/9e70af3f7f5c46609b1c5fab565dea71` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.274622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369acc3f-ea12-425f-98f2-448b2c11ed04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:08.275498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e70af3f7f5c46609b1c5fab565dea71)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:08.277178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369acc3f-ea12-425f-98f2-448b2c11ed04 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:08.278370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:08.316976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 942/1885] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:08 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:08.319024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8273-6bb1-4079-b5a0-f4cf54ce2bea None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.319491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8273-6bb1-4079-b5a0-f4cf54ce2bea None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.320046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8273-6bb1-4079-b5a0-f4cf54ce2bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.347311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e70af3f7f5c46609b1c5fab565dea71', 'request_id': 'req-159abefb-f2fd-4767-8f2c-ea6a83060883'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.355564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:08.358934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e70af3f7f5c46609b1c5fab565dea71', 'request_id': 'req-159abefb-f2fd-4767-8f2c-ea6a83060883'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.370132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0f7f8273-6bb1-4079-b5a0-f4cf54ce2bea None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:08.371953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0f7f8273-6bb1-4079-b5a0-f4cf54ce2bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:08.384435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e70af3f7f5c46609b1c5fab565dea71', 'request_id': 'req-159abefb-f2fd-4767-8f2c-ea6a83060883'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.402895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] The token cache is being invalidate because project 9e70af3f7f5c46609b1c5fab565dea71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:08.403436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.404514 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-159abefb-f2fd-4767-8f2c-ea6a83060883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.409574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 944/1886] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:08 2022] DELETE /identity/v3/projects/9e70af3f7f5c46609b1c5fab565dea71 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:08.409574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd920620-3751-497f-ae82-b2979c33e5b0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.409574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd920620-3751-497f-ae82-b2979c33e5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.409574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd920620-3751-497f-ae82-b2979c33e5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.431053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fd920620-3751-497f-ae82-b2979c33e5b0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:08.432480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fd920620-3751-497f-ae82-b2979c33e5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:08.474408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 943/1887] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:08.474408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8273-6bb1-4079-b5a0-f4cf54ce2bea None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:08.475786 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0f7f8273-6bb1-4079-b5a0-f4cf54ce2bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:08.492610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8273-6bb1-4079-b5a0-f4cf54ce2bea None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:08.498971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954e5e0-c5e2-4c73-a08c-88a83c74f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:08.499730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954e5e0-c5e2-4c73-a08c-88a83c74f021 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.500670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954e5e0-c5e2-4c73-a08c-88a83c74f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.500670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954e5e0-c5e2-4c73-a08c-88a83c74f021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.501577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954e5e0-c5e2-4c73-a08c-88a83c74f021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:08.503459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954e5e0-c5e2-4c73-a08c-88a83c74f021 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:08.531376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 944/1888] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:08.532584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954e5e0-c5e2-4c73-a08c-88a83c74f021 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:08.537796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8954e5e0-c5e2-4c73-a08c-88a83c74f021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:08.549374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 945/1889] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:08.550250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd920620-3751-497f-ae82-b2979c33e5b0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:08.570652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954e5e0-c5e2-4c73-a08c-88a83c74f021 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:08.571840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd920620-3751-497f-ae82-b2979c33e5b0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:08.581141 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:08.582032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1fa53-5eca-4a7e-989c-8d829be1e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:08.583942 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1fa53-5eca-4a7e-989c-8d829be1e13c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.583942 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1fa53-5eca-4a7e-989c-8d829be1e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.583942 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1fa53-5eca-4a7e-989c-8d829be1e13c admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.584916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.584916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.585299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] PATH_INFO: `/v3/users/4e87f11065d54e28a05c3651fdde22ec` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.587367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e87f11065d54e28a05c3651fdde22ec)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:08.588768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1fa53-5eca-4a7e-989c-8d829be1e13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:08.589279 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1fa53-5eca-4a7e-989c-8d829be1e13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:08.589394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:08.592049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1fa53-5eca-4a7e-989c-8d829be1e13c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:08.605920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 946/1890] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:08.606692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1fa53-5eca-4a7e-989c-8d829be1e13c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:08.617305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1fa53-5eca-4a7e-989c-8d829be1e13c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:08.624600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec4467-6c90-4d5d-a17f-9b857ac54270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:08.624942 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4467-6c90-4d5d-a17f-9b857ac54270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.625513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4467-6c90-4d5d-a17f-9b857ac54270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.625885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4467-6c90-4d5d-a17f-9b857ac54270 admin admin] PATH_INFO: `/v3/projects/3999d49c01de47608debf501505a65ed/users/4748c5da2a1f4798a780b953d10fc490/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.653432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec4467-6c90-4d5d-a17f-9b857ac54270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3999d49c01de47608debf501505a65ed, user_id=4748c5da2a1f4798a780b953d10fc490, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:08.656302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec4467-6c90-4d5d-a17f-9b857ac54270 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:08.667754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e87f11065d54e28a05c3651fdde22ec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.668595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e87f11065d54e28a05c3651fdde22ec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.676756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 947/1891] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:08 2022] PUT /identity/v3/projects/3999d49c01de47608debf501505a65ed/users/4748c5da2a1f4798a780b953d10fc490/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:08.678318 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e39eb-4ef5-4435-a49d-f323ddfbaaa1 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.678716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e39eb-4ef5-4435-a49d-f323ddfbaaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.679059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e39eb-4ef5-4435-a49d-f323ddfbaaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.683225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e87f11065d54e28a05c3651fdde22ec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.713525 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e87f11065d54e28a05c3651fdde22ec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.716577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-416e39eb-4ef5-4435-a49d-f323ddfbaaa1 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:08.718019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-416e39eb-4ef5-4435-a49d-f323ddfbaaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:08.724190 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e87f11065d54e28a05c3651fdde22ec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:08.736057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 945/1892] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:08 2022] DELETE /identity/v3/users/4e87f11065d54e28a05c3651fdde22ec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:08.737043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:08.738680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:08.819055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:08.873783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f859a2-ff39-4cb2-a177-2d9f3b498dd8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:08.874956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 948/1893] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:08.879655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e39eb-4ef5-4435-a49d-f323ddfbaaa1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:08.885205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-416e39eb-4ef5-4435-a49d-f323ddfbaaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:08.885898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd528554-5fc2-49e4-aeb6-879d3190319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:08.887535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd528554-5fc2-49e4-aeb6-879d3190319b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.887892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd528554-5fc2-49e4-aeb6-879d3190319b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.888540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd528554-5fc2-49e4-aeb6-879d3190319b admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.889412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd528554-5fc2-49e4-aeb6-879d3190319b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:08.891874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd528554-5fc2-49e4-aeb6-879d3190319b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:08.911480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e39eb-4ef5-4435-a49d-f323ddfbaaa1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:08.934872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4136b8-fb51-4c5b-a0a5-cbb9199726ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:08.936714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4136b8-fb51-4c5b-a0a5-cbb9199726ff admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:08.936714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4136b8-fb51-4c5b-a0a5-cbb9199726ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:08.937063 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4136b8-fb51-4c5b-a0a5-cbb9199726ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:08.938192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4136b8-fb51-4c5b-a0a5-cbb9199726ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:08.940646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4136b8-fb51-4c5b-a0a5-cbb9199726ff admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:08.959944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 946/1894] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:08 2022] POST /identity/v3/projects => generated 363 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:08.962761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd528554-5fc2-49e4-aeb6-879d3190319b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:08.967958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 949/1895] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:08.973964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4136b8-fb51-4c5b-a0a5-cbb9199726ff admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:08.997301 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4136b8-fb51-4c5b-a0a5-cbb9199726ff admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.057930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:09.113245 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48db8de-2a80-4a25-8c82-230db8843298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.114459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48db8de-2a80-4a25-8c82-230db8843298 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.114765 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48db8de-2a80-4a25-8c82-230db8843298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.116499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48db8de-2a80-4a25-8c82-230db8843298 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.117665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48db8de-2a80-4a25-8c82-230db8843298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.120391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48db8de-2a80-4a25-8c82-230db8843298 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.123838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd528554-5fc2-49e4-aeb6-879d3190319b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.133432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d469-f29b-4d65-a8b0-10121211e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.134066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d469-f29b-4d65-a8b0-10121211e994 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.134348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d469-f29b-4d65-a8b0-10121211e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.134619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d469-f29b-4d65-a8b0-10121211e994 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.135756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8d469-f29b-4d65-a8b0-10121211e994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:09.136064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8d469-f29b-4d65-a8b0-10121211e994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.142904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8d469-f29b-4d65-a8b0-10121211e994 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.165398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 947/1896] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:09.166549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d469-f29b-4d65-a8b0-10121211e994 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.167696 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 950/1897] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:08 2022] POST /identity/v3/users => generated 282 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:09.184074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48db8de-2a80-4a25-8c82-230db8843298 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.188561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d469-f29b-4d65-a8b0-10121211e994 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.194357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab16771-962c-436b-a538-e35f400444a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.195090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16771-962c-436b-a538-e35f400444a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.195370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16771-962c-436b-a538-e35f400444a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.195672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16771-962c-436b-a538-e35f400444a4 admin admin] PATH_INFO: `/v3/projects/3999d49c01de47608debf501505a65ed/users/4748c5da2a1f4798a780b953d10fc490/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.195811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48db8de-2a80-4a25-8c82-230db8843298 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.197637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab16771-962c-436b-a538-e35f400444a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3999d49c01de47608debf501505a65ed, user_id=4748c5da2a1f4798a780b953d10fc490, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.200410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab16771-962c-436b-a538-e35f400444a4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.201929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62105b78-48b1-4f0e-b78c-b894658738d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.202668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105b78-48b1-4f0e-b78c-b894658738d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.202989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105b78-48b1-4f0e-b78c-b894658738d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.203331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105b78-48b1-4f0e-b78c-b894658738d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.204096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62105b78-48b1-4f0e-b78c-b894658738d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.206808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62105b78-48b1-4f0e-b78c-b894658738d6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.214626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 948/1898] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:09 2022] PUT /identity/v3/projects/3999d49c01de47608debf501505a65ed/users/4748c5da2a1f4798a780b953d10fc490/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:09.215534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab16771-962c-436b-a538-e35f400444a4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.247594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 951/1899] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:09 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:09.247594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8202d29-9a74-4a54-bcf6-119f21b5d8e3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.247594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8202d29-9a74-4a54-bcf6-119f21b5d8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.247594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8202d29-9a74-4a54-bcf6-119f21b5d8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.280726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f8202d29-9a74-4a54-bcf6-119f21b5d8e3 None None] MFA Rules not processed for user `4748c5da2a1f4798a780b953d10fc490`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:09.282142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f8202d29-9a74-4a54-bcf6-119f21b5d8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:09.298495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab16771-962c-436b-a538-e35f400444a4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.351659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:09.362723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 952/1900] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:09.365326 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8202d29-9a74-4a54-bcf6-119f21b5d8e3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.366698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7f8d-7db4-4d02-933d-f77598eb14ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.367548 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7f8d-7db4-4d02-933d-f77598eb14ea admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.368203 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7f8d-7db4-4d02-933d-f77598eb14ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.368537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7f8d-7db4-4d02-933d-f77598eb14ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.369317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e7f8d-7db4-4d02-933d-f77598eb14ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.371271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e7f8d-7db4-4d02-933d-f77598eb14ea admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.376806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8202d29-9a74-4a54-bcf6-119f21b5d8e3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.383130 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087d5c-ed53-46d8-9144-7d8cb7f3cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.383849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087d5c-ed53-46d8-9144-7d8cb7f3cb18 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.384141 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087d5c-ed53-46d8-9144-7d8cb7f3cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.384445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087d5c-ed53-46d8-9144-7d8cb7f3cb18 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.385092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c087d5c-ed53-46d8-9144-7d8cb7f3cb18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.385192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 949/1901] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:09.386009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7f8d-7db4-4d02-933d-f77598eb14ea admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.388537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c087d5c-ed53-46d8-9144-7d8cb7f3cb18 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.389498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e61e7f8d-7db4-4d02-933d-f77598eb14ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:09.402229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7f8d-7db4-4d02-933d-f77598eb14ea admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.407096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.407717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.407996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.408266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] PATH_INFO: `/v3/projects/2827ca13ab6b4e94ba4caed2d59b54c7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.412519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 953/1902] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:09 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:09.412659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2827ca13ab6b4e94ba4caed2d59b54c7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.412752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087d5c-ed53-46d8-9144-7d8cb7f3cb18 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.412856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.412943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5c087d5c-ed53-46d8-9144-7d8cb7f3cb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:09.466069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2827ca13ab6b4e94ba4caed2d59b54c7', 'request_id': 'req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:09.473399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2827ca13ab6b4e94ba4caed2d59b54c7', 'request_id': 'req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:09.483062 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087d5c-ed53-46d8-9144-7d8cb7f3cb18 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.484038 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2827ca13ab6b4e94ba4caed2d59b54c7', 'request_id': 'req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:09.497403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] The token cache is being invalidate because project 2827ca13ab6b4e94ba4caed2d59b54c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:09.497593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:09.498258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:09.499826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 950/1903] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:09 2022] DELETE /identity/v3/projects/2827ca13ab6b4e94ba4caed2d59b54c7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:09.504857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.506216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:09.514693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:09.548829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c66de0-f093-4e1c-a455-287a8417cd29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.550309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66de0-f093-4e1c-a455-287a8417cd29 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.550773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66de0-f093-4e1c-a455-287a8417cd29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.551066 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66de0-f093-4e1c-a455-287a8417cd29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.553041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-15c66de0-f093-4e1c-a455-287a8417cd29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:09.602389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bfa74-5852-4aa6-9124-77d0bc92dd82 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.609156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cf671-0bed-4a92-a221-52d1bcd8a981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.609792 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cf671-0bed-4a92-a221-52d1bcd8a981 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.610078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cf671-0bed-4a92-a221-52d1bcd8a981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.610358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cf671-0bed-4a92-a221-52d1bcd8a981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.611135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cf671-0bed-4a92-a221-52d1bcd8a981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.613396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cf671-0bed-4a92-a221-52d1bcd8a981 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.639351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 951/1904] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:09.640231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cf671-0bed-4a92-a221-52d1bcd8a981 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.643686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c66de0-f093-4e1c-a455-287a8417cd29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.645531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c66de0-f093-4e1c-a455-287a8417cd29 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.645950 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-542cf671-0bed-4a92-a221-52d1bcd8a981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:09.657271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 954/1905] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:09.666188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d786-9a42-463c-8e94-b5435d7c03b5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.666923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d786-9a42-463c-8e94-b5435d7c03b5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.667300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d786-9a42-463c-8e94-b5435d7c03b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.692924 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cf671-0bed-4a92-a221-52d1bcd8a981 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.701884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6e91d786-9a42-463c-8e94-b5435d7c03b5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:09.703339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6e91d786-9a42-463c-8e94-b5435d7c03b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:09.703678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bc595-5d82-4517-a4b3-4aaca101d31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.704388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bc595-5d82-4517-a4b3-4aaca101d31d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.704722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bc595-5d82-4517-a4b3-4aaca101d31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.705013 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bc595-5d82-4517-a4b3-4aaca101d31d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.706966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bc595-5d82-4517-a4b3-4aaca101d31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.711790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bc595-5d82-4517-a4b3-4aaca101d31d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.713676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 955/1906] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:09.714844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d786-9a42-463c-8e94-b5435d7c03b5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.747398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d786-9a42-463c-8e94-b5435d7c03b5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.747877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 952/1907] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:09.749363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10accee4-5b01-4683-b4f9-732cb77875a5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.749673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10accee4-5b01-4683-b4f9-732cb77875a5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.749927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10accee4-5b01-4683-b4f9-732cb77875a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.757797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff92d8-a307-4950-92bd-a738951f0f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.758983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff92d8-a307-4950-92bd-a738951f0f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.759277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff92d8-a307-4950-92bd-a738951f0f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.759557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff92d8-a307-4950-92bd-a738951f0f0a admin admin] PATH_INFO: `/v3/projects/6b3bb5aabd384eb7ac5d0d784fa8ef6d/users/3ce0e52ac40846d8abaa29def3c0ae1b/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.781536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-10accee4-5b01-4683-b4f9-732cb77875a5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:09.782789 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-10accee4-5b01-4683-b4f9-732cb77875a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:09.793925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff92d8-a307-4950-92bd-a738951f0f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3bb5aabd384eb7ac5d0d784fa8ef6d, user_id=3ce0e52ac40846d8abaa29def3c0ae1b, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.796465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 953/1908] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:09.796465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10accee4-5b01-4683-b4f9-732cb77875a5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.803456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff92d8-a307-4950-92bd-a738951f0f0a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.812662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10accee4-5b01-4683-b4f9-732cb77875a5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:09.820291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2198718-0700-4cef-82b5-d11857aaabed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:09.821525 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198718-0700-4cef-82b5-d11857aaabed admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.821862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198718-0700-4cef-82b5-d11857aaabed admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.822356 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198718-0700-4cef-82b5-d11857aaabed admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.823238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2198718-0700-4cef-82b5-d11857aaabed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:09.825840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2198718-0700-4cef-82b5-d11857aaabed admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:09.856037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 956/1909] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:09 2022] PUT /identity/v3/projects/6b3bb5aabd384eb7ac5d0d784fa8ef6d/users/3ce0e52ac40846d8abaa29def3c0ae1b/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:09.859068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff92d8-a307-4950-92bd-a738951f0f0a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:09.863471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 954/1910] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:09.865888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ba78-2bf0-4d97-b286-398cd0bbd19b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:09.866410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ba78-2bf0-4d97-b286-398cd0bbd19b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:09.866950 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ba78-2bf0-4d97-b286-398cd0bbd19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:09.912868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e945ba78-2bf0-4d97-b286-398cd0bbd19b None None] MFA Rules not processed for user `3ce0e52ac40846d8abaa29def3c0ae1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:09.914712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e945ba78-2bf0-4d97-b286-398cd0bbd19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:09.949967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:10.039705 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff92d8-a307-4950-92bd-a738951f0f0a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.044722 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1cadd-c0f0-48fc-aeee-eb32dd2e86e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.045590 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1cadd-c0f0-48fc-aeee-eb32dd2e86e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.045933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1cadd-c0f0-48fc-aeee-eb32dd2e86e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.058353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1cadd-c0f0-48fc-aeee-eb32dd2e86e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.061155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1cadd-c0f0-48fc-aeee-eb32dd2e86e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:10.061568 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1cadd-c0f0-48fc-aeee-eb32dd2e86e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.063331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1cadd-c0f0-48fc-aeee-eb32dd2e86e0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.083015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 957/1911] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:10.084011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1cadd-c0f0-48fc-aeee-eb32dd2e86e0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.094348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 955/1912] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:10.095643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945ba78-2bf0-4d97-b286-398cd0bbd19b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.102317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1cadd-c0f0-48fc-aeee-eb32dd2e86e0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.109149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945ba78-2bf0-4d97-b286-398cd0bbd19b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.109696 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee21184-e6e0-460b-ab2d-9efeaa0889a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.110383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee21184-e6e0-460b-ab2d-9efeaa0889a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.110678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee21184-e6e0-460b-ab2d-9efeaa0889a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.110946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee21184-e6e0-460b-ab2d-9efeaa0889a9 admin admin] PATH_INFO: `/v3/projects/4ead3259d33c417186146ef63d302cdc/users/e1336475741a44b6977fc83e622c8845/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.116095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f9382-9c27-475c-ba61-40039badf3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.116937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f9382-9c27-475c-ba61-40039badf3ce admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.117308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f9382-9c27-475c-ba61-40039badf3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.117696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f9382-9c27-475c-ba61-40039badf3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.118446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f9382-9c27-475c-ba61-40039badf3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.120552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f9382-9c27-475c-ba61-40039badf3ce admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.135078 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee21184-e6e0-460b-ab2d-9efeaa0889a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ead3259d33c417186146ef63d302cdc, user_id=e1336475741a44b6977fc83e622c8845, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.138530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee21184-e6e0-460b-ab2d-9efeaa0889a9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.173157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 958/1913] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:10 2022] PUT /identity/v3/projects/4ead3259d33c417186146ef63d302cdc/users/e1336475741a44b6977fc83e622c8845/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:10.174254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee21184-e6e0-460b-ab2d-9efeaa0889a9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.182065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 956/1914] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:10 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:10.182065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f1aac-c781-4668-946b-4085c708c6ca None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.182065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f1aac-c781-4668-946b-4085c708c6ca None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.182901 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f1aac-c781-4668-946b-4085c708c6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.218249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:10.231212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-074f1aac-c781-4668-946b-4085c708c6ca None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:10.234776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-074f1aac-c781-4668-946b-4085c708c6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:10.317422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee21184-e6e0-460b-ab2d-9efeaa0889a9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.348589 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 957/1915] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:10.349913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f1aac-c781-4668-946b-4085c708c6ca None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.360946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f1aac-c781-4668-946b-4085c708c6ca None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.366991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5afc1-05e7-4bb8-b6c2-9bdec3217be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.367618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5afc1-05e7-4bb8-b6c2-9bdec3217be4 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.368086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5afc1-05e7-4bb8-b6c2-9bdec3217be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.368408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5afc1-05e7-4bb8-b6c2-9bdec3217be4 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.369119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5afc1-05e7-4bb8-b6c2-9bdec3217be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.371759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5afc1-05e7-4bb8-b6c2-9bdec3217be4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.395612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 958/1916] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:10 2022] POST /identity/v3/users => generated 285 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:10.396549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5afc1-05e7-4bb8-b6c2-9bdec3217be4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.401142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b0e5afc1-05e7-4bb8-b6c2-9bdec3217be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:10.410474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc86554-c83d-448d-a3fc-809215392694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.411093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc86554-c83d-448d-a3fc-809215392694 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.411379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc86554-c83d-448d-a3fc-809215392694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.411660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc86554-c83d-448d-a3fc-809215392694 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.412301 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc86554-c83d-448d-a3fc-809215392694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.413339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5afc1-05e7-4bb8-b6c2-9bdec3217be4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.414243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc86554-c83d-448d-a3fc-809215392694 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.418084 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.418707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.418983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.419252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] PATH_INFO: `/v3/users/e49d237f228d4b0e8d516a2bffb27242` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.420434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49d237f228d4b0e8d516a2bffb27242)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.422310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.448384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 959/1917] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:10 2022] POST /identity/v3/projects => generated 363 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:10.448384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc86554-c83d-448d-a3fc-809215392694 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.450292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9dc86554-c83d-448d-a3fc-809215392694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:10.473817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49d237f228d4b0e8d516a2bffb27242'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:10.474497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49d237f228d4b0e8d516a2bffb27242'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:10.482167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49d237f228d4b0e8d516a2bffb27242'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:10.498039 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49d237f228d4b0e8d516a2bffb27242'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:10.507628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49d237f228d4b0e8d516a2bffb27242'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:10.509612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:10.515607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 959/1918] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:10 2022] DELETE /identity/v3/users/e49d237f228d4b0e8d516a2bffb27242 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:10.515742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc86554-c83d-448d-a3fc-809215392694 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.516494 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.519350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:10.567328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ce4fc-f65c-4ab3-ba0c-83cae56d103e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.568036 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ce4fc-f65c-4ab3-ba0c-83cae56d103e service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.568416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ce4fc-f65c-4ab3-ba0c-83cae56d103e service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.568764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ce4fc-f65c-4ab3-ba0c-83cae56d103e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.570592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ef8ce4fc-f65c-4ab3-ba0c-83cae56d103e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:10.586597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f9f87-cfab-4f12-969c-c1dd9c9c1c47 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.589439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:10.595344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a12a14-e962-4130-b63e-9f74147ef550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.596018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a12a14-e962-4130-b63e-9f74147ef550 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.596999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a12a14-e962-4130-b63e-9f74147ef550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.597289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a12a14-e962-4130-b63e-9f74147ef550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.597940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a12a14-e962-4130-b63e-9f74147ef550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.599558 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a12a14-e962-4130-b63e-9f74147ef550 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.613642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 960/1919] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:10.613642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a12a14-e962-4130-b63e-9f74147ef550 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.613642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-45a12a14-e962-4130-b63e-9f74147ef550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:10.625903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a12a14-e962-4130-b63e-9f74147ef550 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.630758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3a5b0-1d84-4c48-bc38-20e0c8f58e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.631279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a5b0-1d84-4c48-bc38-20e0c8f58e39 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.631569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a5b0-1d84-4c48-bc38-20e0c8f58e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.631844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a5b0-1d84-4c48-bc38-20e0c8f58e39 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.632507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3a5b0-1d84-4c48-bc38-20e0c8f58e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.634471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3a5b0-1d84-4c48-bc38-20e0c8f58e39 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.641363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ce4fc-f65c-4ab3-ba0c-83cae56d103e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.642974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ce4fc-f65c-4ab3-ba0c-83cae56d103e service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.654293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 960/1920] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:10.655551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cafe7-047e-4190-bac8-bd071e10a3aa None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.655846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cafe7-047e-4190-bac8-bd071e10a3aa None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.659830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cafe7-047e-4190-bac8-bd071e10a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.659956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 961/1921] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:10 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:10.659956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3a5b0-1d84-4c48-bc38-20e0c8f58e39 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.669695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3a5b0-1d84-4c48-bc38-20e0c8f58e39 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.677790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fe8cafe7-047e-4190-bac8-bd071e10a3aa None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:10.678967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80354b-ba70-4535-bcb0-17c855ec3871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.679187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fe8cafe7-047e-4190-bac8-bd071e10a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:10.679753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80354b-ba70-4535-bcb0-17c855ec3871 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.679942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80354b-ba70-4535-bcb0-17c855ec3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.680539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80354b-ba70-4535-bcb0-17c855ec3871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.681285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80354b-ba70-4535-bcb0-17c855ec3871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.683048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80354b-ba70-4535-bcb0-17c855ec3871 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.693859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 961/1922] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:10.695584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cafe7-047e-4190-bac8-bd071e10a3aa None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.704076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 962/1923] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:10.705035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80354b-ba70-4535-bcb0-17c855ec3871 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.707990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7c80354b-ba70-4535-bcb0-17c855ec3871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:10.708136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cafe7-047e-4190-bac8-bd071e10a3aa None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.712823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59f588-d7fb-45c8-bd9f-526323c2ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.713451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59f588-d7fb-45c8-bd9f-526323c2ecfc admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.714050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59f588-d7fb-45c8-bd9f-526323c2ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.714050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59f588-d7fb-45c8-bd9f-526323c2ecfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.715167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59f588-d7fb-45c8-bd9f-526323c2ecfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.716488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59f588-d7fb-45c8-bd9f-526323c2ecfc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.721302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80354b-ba70-4535-bcb0-17c855ec3871 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.725570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c1a97-b7f5-4867-9328-e503093bdced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.726390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c1a97-b7f5-4867-9328-e503093bdced service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.726898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c1a97-b7f5-4867-9328-e503093bdced service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.727400 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c1a97-b7f5-4867-9328-e503093bdced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.728411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 962/1924] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:10.729590 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59f588-d7fb-45c8-bd9f-526323c2ecfc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.742262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59f588-d7fb-45c8-bd9f-526323c2ecfc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.743373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c1a97-b7f5-4867-9328-e503093bdced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.745887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c1a97-b7f5-4867-9328-e503093bdced service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.748360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a5c52-a3fd-45f5-ad36-93c0db5c416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.749240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a5c52-a3fd-45f5-ad36-93c0db5c416d admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.749699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a5c52-a3fd-45f5-ad36-93c0db5c416d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.749984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a5c52-a3fd-45f5-ad36-93c0db5c416d admin admin] PATH_INFO: `/v3/projects/5a420e29d0ce4ba8adb30477458e5f7a/users/b2a31f93f257436195aba2de90dbb163/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.763775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 963/1925] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:10.765793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c1a97-b7f5-4867-9328-e503093bdced service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:10.770077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a5c52-a3fd-45f5-ad36-93c0db5c416d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a420e29d0ce4ba8adb30477458e5f7a, user_id=b2a31f93f257436195aba2de90dbb163, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.774019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a5c52-a3fd-45f5-ad36-93c0db5c416d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.782907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c1a97-b7f5-4867-9328-e503093bdced service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:10.804503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 963/1926] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:10 2022] PUT /identity/v3/projects/5a420e29d0ce4ba8adb30477458e5f7a/users/b2a31f93f257436195aba2de90dbb163/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:10.807355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae093b4-4edc-40ad-b88a-72554a87c361 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.807661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae093b4-4edc-40ad-b88a-72554a87c361 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.807945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae093b4-4edc-40ad-b88a-72554a87c361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.867049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-bae093b4-4edc-40ad-b88a-72554a87c361 None None] MFA Rules not processed for user `b2a31f93f257436195aba2de90dbb163`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:10.884030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bae093b4-4edc-40ad-b88a-72554a87c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:10.904092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2418707-93c9-4925-996a-fd588e5c5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:10.904858 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2418707-93c9-4925-996a-fd588e5c5a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:10.905084 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2418707-93c9-4925-996a-fd588e5c5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:10.905484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2418707-93c9-4925-996a-fd588e5c5a29 admin admin] PATH_INFO: `/v3/projects/e61716112bbb436ea6df271a2889c732/users/69c18c94203543f592ac6512219a2cf3/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:10.924433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2418707-93c9-4925-996a-fd588e5c5a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61716112bbb436ea6df271a2889c732, user_id=69c18c94203543f592ac6512219a2cf3, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:10.927308 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2418707-93c9-4925-996a-fd588e5c5a29 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:10.979260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 964/1927] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:10 2022] PUT /identity/v3/projects/e61716112bbb436ea6df271a2889c732/users/69c18c94203543f592ac6512219a2cf3/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:10.982851 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2418707-93c9-4925-996a-fd588e5c5a29 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:11.056827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:11.064804 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 964/1928] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:11.070519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae093b4-4edc-40ad-b88a-72554a87c361 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:11.095619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae093b4-4edc-40ad-b88a-72554a87c361 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:11.095765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2418707-93c9-4925-996a-fd588e5c5a29 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:11.103345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80244e2b-fca6-42de-842a-ec7c8461d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:11.104199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80244e2b-fca6-42de-842a-ec7c8461d69b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:11.104617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80244e2b-fca6-42de-842a-ec7c8461d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:11.104987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80244e2b-fca6-42de-842a-ec7c8461d69b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:11.105785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80244e2b-fca6-42de-842a-ec7c8461d69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:11.109428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80244e2b-fca6-42de-842a-ec7c8461d69b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:11.114233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80285d2-8ebb-4e43-a697-5f7e8b53a8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:11.115191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80285d2-8ebb-4e43-a697-5f7e8b53a8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:11.115484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80285d2-8ebb-4e43-a697-5f7e8b53a8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:11.115917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80285d2-8ebb-4e43-a697-5f7e8b53a8c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:11.117297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80285d2-8ebb-4e43-a697-5f7e8b53a8c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:11.119530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80285d2-8ebb-4e43-a697-5f7e8b53a8c2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:11.124013 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 965/1929] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:11.131230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80244e2b-fca6-42de-842a-ec7c8461d69b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:11.166057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80244e2b-fca6-42de-842a-ec7c8461d69b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:11.182467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69153a53-cf5f-4cd6-8d34-eb8c51d63892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:11.186859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69153a53-cf5f-4cd6-8d34-eb8c51d63892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:11.187178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69153a53-cf5f-4cd6-8d34-eb8c51d63892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:11.187470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69153a53-cf5f-4cd6-8d34-eb8c51d63892 admin admin] PATH_INFO: `/v3/projects/e61716112bbb436ea6df271a2889c732/users/69c18c94203543f592ac6512219a2cf3/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:11.193308 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 965/1930] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:11 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:11.194302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80285d2-8ebb-4e43-a697-5f7e8b53a8c2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:11.197334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69153a53-cf5f-4cd6-8d34-eb8c51d63892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61716112bbb436ea6df271a2889c732, user_id=69c18c94203543f592ac6512219a2cf3, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:11.206865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69153a53-cf5f-4cd6-8d34-eb8c51d63892 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:11.251767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 966/1931] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:11 2022] PUT /identity/v3/projects/e61716112bbb436ea6df271a2889c732/users/69c18c94203543f592ac6512219a2cf3/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:11.261471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:11.265992 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4141a2-214a-4333-9cba-d61164642320 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:11.266296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4141a2-214a-4333-9cba-d61164642320 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:11.266600 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4141a2-214a-4333-9cba-d61164642320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:11.289030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80285d2-8ebb-4e43-a697-5f7e8b53a8c2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:11.360940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09aa42-6077-4bcd-acd7-9db7b2c4c1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:11.362391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09aa42-6077-4bcd-acd7-9db7b2c4c1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:11.362803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09aa42-6077-4bcd-acd7-9db7b2c4c1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:11.363177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09aa42-6077-4bcd-acd7-9db7b2c4c1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:11.363906 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09aa42-6077-4bcd-acd7-9db7b2c4c1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:11.366610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09aa42-6077-4bcd-acd7-9db7b2c4c1a8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:11.399921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 966/1932] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:11 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:11.401222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09aa42-6077-4bcd-acd7-9db7b2c4c1a8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:11.402007 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-be4141a2-214a-4333-9cba-d61164642320 None None] MFA Rules not processed for user `69c18c94203543f592ac6512219a2cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:11.403990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3c09aa42-6077-4bcd-acd7-9db7b2c4c1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:11.405925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-be4141a2-214a-4333-9cba-d61164642320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:11.418925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09aa42-6077-4bcd-acd7-9db7b2c4c1a8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:11.446777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:11.447441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:11.447726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:11.448002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] PATH_INFO: `/v3/projects/67a8e129d3a640daa3f2c2c257768d04` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:11.449278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a8e129d3a640daa3f2c2c257768d04)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:11.451315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:11.515208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a8e129d3a640daa3f2c2c257768d04', 'request_id': 'req-9d7935fc-bbc3-4b4b-a830-5840bac73023'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:11.524524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a8e129d3a640daa3f2c2c257768d04', 'request_id': 'req-9d7935fc-bbc3-4b4b-a830-5840bac73023'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:11.536556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a8e129d3a640daa3f2c2c257768d04', 'request_id': 'req-9d7935fc-bbc3-4b4b-a830-5840bac73023'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:11.562276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] The token cache is being invalidate because project 67a8e129d3a640daa3f2c2c257768d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:11.562580 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:11.563300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:11.568259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 967/1933] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:11 2022] DELETE /identity/v3/projects/67a8e129d3a640daa3f2c2c257768d04 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:11.569229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:11.571773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:11.602493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 967/1934] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:11.605108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4141a2-214a-4333-9cba-d61164642320 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:11.640690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4141a2-214a-4333-9cba-d61164642320 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:11.663334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7935fc-bbc3-4b4b-a830-5840bac73023 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:11.669102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f08e9-d80e-4c55-ac62-0aec7b524b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:11.669670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f08e9-d80e-4c55-ac62-0aec7b524b19 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:11.669958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f08e9-d80e-4c55-ac62-0aec7b524b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:11.670243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f08e9-d80e-4c55-ac62-0aec7b524b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:11.670911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f08e9-d80e-4c55-ac62-0aec7b524b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:11.672929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f08e9-d80e-4c55-ac62-0aec7b524b19 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:11.675236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:11.690513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 968/1935] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:11.692199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f08e9-d80e-4c55-ac62-0aec7b524b19 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:11.695733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-335f08e9-d80e-4c55-ac62-0aec7b524b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:11.798150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:11.800460 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:11.801529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:11.802155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] PATH_INFO: `/v3/users/4748c5da2a1f4798a780b953d10fc490` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:11.804590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4748c5da2a1f4798a780b953d10fc490)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:11.807900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:11.808044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f08e9-d80e-4c55-ac62-0aec7b524b19 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:11.816307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95a42d-b254-4639-817d-594942590ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:11.817289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95a42d-b254-4639-817d-594942590ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:11.817725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95a42d-b254-4639-817d-594942590ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:11.818873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95a42d-b254-4639-817d-594942590ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:11.824518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9b95a42d-b254-4639-817d-594942590ea6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:11.882812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:11.885778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4748c5da2a1f4798a780b953d10fc490'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:11.886669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4748c5da2a1f4798a780b953d10fc490'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:11.908487 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4748c5da2a1f4798a780b953d10fc490'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:11.928898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4748c5da2a1f4798a780b953d10fc490'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:11.938658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4748c5da2a1f4798a780b953d10fc490'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:11.952800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 968/1936] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:11 2022] DELETE /identity/v3/users/4748c5da2a1f4798a780b953d10fc490 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:11.953686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:11.955147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:11.956994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95a42d-b254-4639-817d-594942590ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:11.959016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95a42d-b254-4639-817d-594942590ea6 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:11.978121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 969/1937] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:12.090939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113f60-8ffd-4cad-87c2-44848aa61190 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:12.091229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113f60-8ffd-4cad-87c2-44848aa61190 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:12.091508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113f60-8ffd-4cad-87c2-44848aa61190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:12.139939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1657ab9-f456-4c95-9858-91eda22f8072 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:12.169300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f6874-ad6f-4bb4-9bb2-7bea4ca7ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:12.170562 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f6874-ad6f-4bb4-9bb2-7bea4ca7ebad admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:12.170562 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f6874-ad6f-4bb4-9bb2-7bea4ca7ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:12.170725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f6874-ad6f-4bb4-9bb2-7bea4ca7ebad admin admin] PATH_INFO: `/v3/projects/0f9fadd487a64632844a35413d668bad/users/a0b75c753c39414991fe365588c68461/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:12.175576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-79113f60-8ffd-4cad-87c2-44848aa61190 None None] MFA Rules not processed for user `e1336475741a44b6977fc83e622c8845`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:12.178989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-79113f60-8ffd-4cad-87c2-44848aa61190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:12.213540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f6874-ad6f-4bb4-9bb2-7bea4ca7ebad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9fadd487a64632844a35413d668bad, user_id=a0b75c753c39414991fe365588c68461, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:12.216831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f6874-ad6f-4bb4-9bb2-7bea4ca7ebad admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:12.247404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 969/1938] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:11 2022] PUT /identity/v3/projects/0f9fadd487a64632844a35413d668bad/users/a0b75c753c39414991fe365588c68461/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:12.251341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f6874-ad6f-4bb4-9bb2-7bea4ca7ebad admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:12.348755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 970/1939] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:12.353702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79113f60-8ffd-4cad-87c2-44848aa61190 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:12.356215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-79113f60-8ffd-4cad-87c2-44848aa61190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:12.368764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f6874-ad6f-4bb4-9bb2-7bea4ca7ebad admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:12.381456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79113f60-8ffd-4cad-87c2-44848aa61190 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:12.384351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282c38-93d9-4d19-bd25-a89f4a5e8791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:12.385288 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282c38-93d9-4d19-bd25-a89f4a5e8791 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:12.387118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282c38-93d9-4d19-bd25-a89f4a5e8791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:12.387477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282c38-93d9-4d19-bd25-a89f4a5e8791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:12.388693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73282c38-93d9-4d19-bd25-a89f4a5e8791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:12.388868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e880d5-3748-4e08-b1dc-fc56ba15d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:12.389675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e880d5-3748-4e08-b1dc-fc56ba15d8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:12.390006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e880d5-3748-4e08-b1dc-fc56ba15d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:12.390371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e880d5-3748-4e08-b1dc-fc56ba15d8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:12.391080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e880d5-3748-4e08-b1dc-fc56ba15d8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:12.392104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73282c38-93d9-4d19-bd25-a89f4a5e8791 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:12.393849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e880d5-3748-4e08-b1dc-fc56ba15d8a5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:12.427197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 970/1940] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:12.435610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282c38-93d9-4d19-bd25-a89f4a5e8791 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:12.456363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 971/1941] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:12 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:12.460837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e880d5-3748-4e08-b1dc-fc56ba15d8a5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:12.463581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282c38-93d9-4d19-bd25-a89f4a5e8791 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:12.490650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:12.562844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:12.581903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e880d5-3748-4e08-b1dc-fc56ba15d8a5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:12.582146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcfa02-ac0c-4d98-a31f-5b73d570196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:12.583276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcfa02-ac0c-4d98-a31f-5b73d570196c admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:12.584527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcfa02-ac0c-4d98-a31f-5b73d570196c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:12.585182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcfa02-ac0c-4d98-a31f-5b73d570196c admin admin] PATH_INFO: `/v3/projects/0f9fadd487a64632844a35413d668bad/users/a0b75c753c39414991fe365588c68461/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:12.587837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcfa02-ac0c-4d98-a31f-5b73d570196c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9fadd487a64632844a35413d668bad, user_id=a0b75c753c39414991fe365588c68461, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:12.590002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785a137-f175-4f25-8123-1e862d41bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:12.590627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785a137-f175-4f25-8123-1e862d41bcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:12.590909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785a137-f175-4f25-8123-1e862d41bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:12.591184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785a137-f175-4f25-8123-1e862d41bcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:12.591448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcfa02-ac0c-4d98-a31f-5b73d570196c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:12.591822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785a137-f175-4f25-8123-1e862d41bcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:12.593952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785a137-f175-4f25-8123-1e862d41bcd8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:12.612801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 971/1942] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:12 2022] PUT /identity/v3/projects/0f9fadd487a64632844a35413d668bad/users/a0b75c753c39414991fe365588c68461/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:12.615134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab377-2fb9-4f6d-8a76-3f6b29596f90 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:12.615542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab377-2fb9-4f6d-8a76-3f6b29596f90 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:12.615892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab377-2fb9-4f6d-8a76-3f6b29596f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:12.646483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 972/1943] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:12 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:12.650618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785a137-f175-4f25-8123-1e862d41bcd8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:12.654572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2d5ab377-2fb9-4f6d-8a76-3f6b29596f90 None None] MFA Rules not processed for user `a0b75c753c39414991fe365588c68461`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:12.655953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2d5ab377-2fb9-4f6d-8a76-3f6b29596f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:12.680506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785a137-f175-4f25-8123-1e862d41bcd8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:12.819663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 972/1944] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:12.821667 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ab377-2fb9-4f6d-8a76-3f6b29596f90 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:12.825580 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2d5ab377-2fb9-4f6d-8a76-3f6b29596f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:12.841458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba9dca-179e-4164-ac29-997e01eec90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:12.842154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9dca-179e-4164-ac29-997e01eec90b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:12.842470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9dca-179e-4164-ac29-997e01eec90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:12.842751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9dca-179e-4164-ac29-997e01eec90b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:12.843730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba9dca-179e-4164-ac29-997e01eec90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:12.846023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba9dca-179e-4164-ac29-997e01eec90b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:12.868053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 973/1945] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:12.868053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba9dca-179e-4164-ac29-997e01eec90b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:12.870626 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b8ba9dca-179e-4164-ac29-997e01eec90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:12.961745 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ab377-2fb9-4f6d-8a76-3f6b29596f90 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:12.969812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:12.972708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:12.973202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:12.973332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] PATH_INFO: `/v3/projects/3999d49c01de47608debf501505a65ed` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:12.973953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba9dca-179e-4164-ac29-997e01eec90b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:12.975785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3999d49c01de47608debf501505a65ed)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:12.978452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62175d7-96f1-4c26-980c-8b8a6a5c5e70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:12.979196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62175d7-96f1-4c26-980c-8b8a6a5c5e70 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:12.979549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62175d7-96f1-4c26-980c-8b8a6a5c5e70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:12.979799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:12.979921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62175d7-96f1-4c26-980c-8b8a6a5c5e70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.009340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62175d7-96f1-4c26-980c-8b8a6a5c5e70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:13.010808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62175d7-96f1-4c26-980c-8b8a6a5c5e70 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:13.024553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 974/1946] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:13.025886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62175d7-96f1-4c26-980c-8b8a6a5c5e70 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:13.058368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3999d49c01de47608debf501505a65ed', 'request_id': 'req-4c001cb1-7f34-4591-8229-8b968aea52fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:13.067477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3999d49c01de47608debf501505a65ed', 'request_id': 'req-4c001cb1-7f34-4591-8229-8b968aea52fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:13.068056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62175d7-96f1-4c26-980c-8b8a6a5c5e70 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:13.072740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:13.078559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3999d49c01de47608debf501505a65ed', 'request_id': 'req-4c001cb1-7f34-4591-8229-8b968aea52fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:13.096458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] The token cache is being invalidate because project 3999d49c01de47608debf501505a65ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:13.096751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:13.097302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:13.102295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 973/1947] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:12 2022] DELETE /identity/v3/projects/3999d49c01de47608debf501505a65ed => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:13.102295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:13.102295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:13.132925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:13.156614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff61719-907b-4057-918b-abd1e9c79ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:13.157334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff61719-907b-4057-918b-abd1e9c79ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.157628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff61719-907b-4057-918b-abd1e9c79ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.157908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff61719-907b-4057-918b-abd1e9c79ccc admin admin] PATH_INFO: `/v3/projects/b4ebdb85732b4bf98fb15c538f1d329f/users/73ee3289920c44869d229d3032d8326e/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.175300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff61719-907b-4057-918b-abd1e9c79ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ebdb85732b4bf98fb15c538f1d329f, user_id=73ee3289920c44869d229d3032d8326e, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:13.177940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff61719-907b-4057-918b-abd1e9c79ccc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:13.182826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c001cb1-7f34-4591-8229-8b968aea52fd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:13.189082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:13.190685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.191517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.192072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] PATH_INFO: `/v3/users/3ce0e52ac40846d8abaa29def3c0ae1b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.194842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce0e52ac40846d8abaa29def3c0ae1b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:13.197742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:13.200608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 975/1948] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:13 2022] PUT /identity/v3/projects/b4ebdb85732b4bf98fb15c538f1d329f/users/73ee3289920c44869d229d3032d8326e/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:13.202558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b433c7e-926e-4f60-96e1-d2ea12c2bc2d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.202871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b433c7e-926e-4f60-96e1-d2ea12c2bc2d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.203258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b433c7e-926e-4f60-96e1-d2ea12c2bc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.241451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4b433c7e-926e-4f60-96e1-d2ea12c2bc2d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:13.242659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4b433c7e-926e-4f60-96e1-d2ea12c2bc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:13.281665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce0e52ac40846d8abaa29def3c0ae1b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:13.282758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce0e52ac40846d8abaa29def3c0ae1b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:13.295253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce0e52ac40846d8abaa29def3c0ae1b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:13.312598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce0e52ac40846d8abaa29def3c0ae1b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:13.321906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6adcaa5c-81ec-43a0-8aff-352c47ac9ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce0e52ac40846d8abaa29def3c0ae1b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:13.324567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 976/1949] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:13.325587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b433c7e-926e-4f60-96e1-d2ea12c2bc2d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:13.327160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4b433c7e-926e-4f60-96e1-d2ea12c2bc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:13.341101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b433c7e-926e-4f60-96e1-d2ea12c2bc2d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:13.342463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 974/1950] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:13 2022] DELETE /identity/v3/users/3ce0e52ac40846d8abaa29def3c0ae1b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:13.344969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ade708-dff3-4324-9252-69bf7e83dbbe None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.345812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ade708-dff3-4324-9252-69bf7e83dbbe None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.346725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ade708-dff3-4324-9252-69bf7e83dbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.371846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-80ade708-dff3-4324-9252-69bf7e83dbbe None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:13.373141 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-80ade708-dff3-4324-9252-69bf7e83dbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:13.426757 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00258a8b-b69a-4b8d-87ec-4f7735114564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:13.427532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00258a8b-b69a-4b8d-87ec-4f7735114564 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.427785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00258a8b-b69a-4b8d-87ec-4f7735114564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.428148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00258a8b-b69a-4b8d-87ec-4f7735114564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.428970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00258a8b-b69a-4b8d-87ec-4f7735114564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:13.430908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00258a8b-b69a-4b8d-87ec-4f7735114564 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:13.463633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 977/1951] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:13.467682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9ac96-b527-479c-83fe-5461f6b7e603 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.468654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 975/1952] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:13.469082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9ac96-b527-479c-83fe-5461f6b7e603 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.469888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ade708-dff3-4324-9252-69bf7e83dbbe None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:13.471807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-80ade708-dff3-4324-9252-69bf7e83dbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:13.472377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9ac96-b527-479c-83fe-5461f6b7e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.485694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ade708-dff3-4324-9252-69bf7e83dbbe None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:13.496216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa450f5-1871-4a3d-9624-98610f93ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:13.496860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa450f5-1871-4a3d-9624-98610f93ac6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.497141 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa450f5-1871-4a3d-9624-98610f93ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.497417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa450f5-1871-4a3d-9624-98610f93ac6a admin admin] PATH_INFO: `/v3/projects/b4ebdb85732b4bf98fb15c538f1d329f/users/73ee3289920c44869d229d3032d8326e/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.503887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa450f5-1871-4a3d-9624-98610f93ac6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ebdb85732b4bf98fb15c538f1d329f, user_id=73ee3289920c44869d229d3032d8326e, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:13.508157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa450f5-1871-4a3d-9624-98610f93ac6a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:13.515525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-80c9ac96-b527-479c-83fe-5461f6b7e603 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:13.517535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-80c9ac96-b527-479c-83fe-5461f6b7e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:13.522179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:13.530803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 976/1953] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:13 2022] PUT /identity/v3/projects/b4ebdb85732b4bf98fb15c538f1d329f/users/73ee3289920c44869d229d3032d8326e/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:13.532204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa450f5-1871-4a3d-9624-98610f93ac6a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:13.534776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 978/1954] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:13.549968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9ac96-b527-479c-83fe-5461f6b7e603 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:13.553514 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-80c9ac96-b527-479c-83fe-5461f6b7e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:13.667572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa450f5-1871-4a3d-9624-98610f93ac6a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:13.687596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9ac96-b527-479c-83fe-5461f6b7e603 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:13.690746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e63a3f-362b-4f97-8fe0-80f0a59ada39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:13.691690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e63a3f-362b-4f97-8fe0-80f0a59ada39 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.692046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e63a3f-362b-4f97-8fe0-80f0a59ada39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.692441 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e63a3f-362b-4f97-8fe0-80f0a59ada39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.693264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e63a3f-362b-4f97-8fe0-80f0a59ada39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:13.693636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e63a3f-362b-4f97-8fe0-80f0a59ada39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:13.695438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e63a3f-362b-4f97-8fe0-80f0a59ada39 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:13.697363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:13.714194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 977/1955] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:13.718283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e63a3f-362b-4f97-8fe0-80f0a59ada39 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:13.735915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e63a3f-362b-4f97-8fe0-80f0a59ada39 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:13.742585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4c2fb-74e3-428d-9cab-0df9b3723d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:13.743608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4c2fb-74e3-428d-9cab-0df9b3723d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.743971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4c2fb-74e3-428d-9cab-0df9b3723d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.744309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4c2fb-74e3-428d-9cab-0df9b3723d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.745115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4c2fb-74e3-428d-9cab-0df9b3723d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:13.747377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4c2fb-74e3-428d-9cab-0df9b3723d00 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:13.763248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9ec9d-8a0b-4466-9170-5a45d2d0a968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:13.764484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9ec9d-8a0b-4466-9170-5a45d2d0a968 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.764771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9ec9d-8a0b-4466-9170-5a45d2d0a968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.765054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9ec9d-8a0b-4466-9170-5a45d2d0a968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.782463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9ec9d-8a0b-4466-9170-5a45d2d0a968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:13.785130 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9ec9d-8a0b-4466-9170-5a45d2d0a968 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:13.810602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 978/1956] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:13 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:13.811419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 979/1957] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:13.821993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9ec9d-8a0b-4466-9170-5a45d2d0a968 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:13.841228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9ec9d-8a0b-4466-9170-5a45d2d0a968 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:13.938124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6187c-d891-453e-be10-1e0ee8cc2eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:13.938929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6187c-d891-453e-be10-1e0ee8cc2eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:13.939338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6187c-d891-453e-be10-1e0ee8cc2eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:13.939768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6187c-d891-453e-be10-1e0ee8cc2eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:13.941580 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6187c-d891-453e-be10-1e0ee8cc2eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:13.944157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6187c-d891-453e-be10-1e0ee8cc2eb0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:13.988291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 980/1958] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:13 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:13.992273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4c2fb-74e3-428d-9cab-0df9b3723d00 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:14.009360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4c2fb-74e3-428d-9cab-0df9b3723d00 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:14.016639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904e22-711a-4fca-99f7-1bfd9facd473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:14.017700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904e22-711a-4fca-99f7-1bfd9facd473 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:14.017991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904e22-711a-4fca-99f7-1bfd9facd473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:14.018877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904e22-711a-4fca-99f7-1bfd9facd473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:14.020358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904e22-711a-4fca-99f7-1bfd9facd473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:14.023239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904e22-711a-4fca-99f7-1bfd9facd473 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:14.042483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 979/1959] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:14.046561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6187c-d891-453e-be10-1e0ee8cc2eb0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:14.058999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6187c-d891-453e-be10-1e0ee8cc2eb0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:14.069771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb6383-0885-4ae4-88bf-ffa0b4fcf97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:14.075742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb6383-0885-4ae4-88bf-ffa0b4fcf97f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:14.075966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb6383-0885-4ae4-88bf-ffa0b4fcf97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:14.076254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb6383-0885-4ae4-88bf-ffa0b4fcf97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:14.077849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb6383-0885-4ae4-88bf-ffa0b4fcf97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:14.079550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb6383-0885-4ae4-88bf-ffa0b4fcf97f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:14.137114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904e22-711a-4fca-99f7-1bfd9facd473 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:14.138796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 981/1960] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:14.158547 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904e22-711a-4fca-99f7-1bfd9facd473 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:14.168864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef8202-ce61-446f-8a9e-fc0d86d6a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:14.169643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef8202-ce61-446f-8a9e-fc0d86d6a253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:14.169920 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef8202-ce61-446f-8a9e-fc0d86d6a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:14.170202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef8202-ce61-446f-8a9e-fc0d86d6a253 admin admin] PATH_INFO: `/v3/projects/c4b0cb83511b4ee7a26c929858e9cccf/users/a9a35e99c8c342a2ba2821429f3e5422/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:14.239208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef8202-ce61-446f-8a9e-fc0d86d6a253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b0cb83511b4ee7a26c929858e9cccf, user_id=a9a35e99c8c342a2ba2821429f3e5422, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:14.244139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef8202-ce61-446f-8a9e-fc0d86d6a253 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:14.268682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 980/1961] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:14 2022] PUT /identity/v3/projects/c4b0cb83511b4ee7a26c929858e9cccf/users/a9a35e99c8c342a2ba2821429f3e5422/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:14.279816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973766-3dbe-4dfc-8363-85edc8d9b44c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:14.280109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973766-3dbe-4dfc-8363-85edc8d9b44c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:14.280422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973766-3dbe-4dfc-8363-85edc8d9b44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:14.318064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fe973766-3dbe-4dfc-8363-85edc8d9b44c None None] MFA Rules not processed for user `a9a35e99c8c342a2ba2821429f3e5422`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:14.319277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fe973766-3dbe-4dfc-8363-85edc8d9b44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:14.489904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 982/1962] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:14.491060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef8202-ce61-446f-8a9e-fc0d86d6a253 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:14.563967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe973766-3dbe-4dfc-8363-85edc8d9b44c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:14.565915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fe973766-3dbe-4dfc-8363-85edc8d9b44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:14.629796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef8202-ce61-446f-8a9e-fc0d86d6a253 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:14.640078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cccb9b-908d-4559-b129-1b2d893b66aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:14.641169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cccb9b-908d-4559-b129-1b2d893b66aa admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:14.641169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cccb9b-908d-4559-b129-1b2d893b66aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:14.641375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cccb9b-908d-4559-b129-1b2d893b66aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:14.642345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cccb9b-908d-4559-b129-1b2d893b66aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:14.645264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:14.646588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cccb9b-908d-4559-b129-1b2d893b66aa admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:14.717816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 981/1963] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:14 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:14.719121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8ae68-3571-4b73-91ce-4df3216daa1e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:14.719420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8ae68-3571-4b73-91ce-4df3216daa1e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:14.719700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8ae68-3571-4b73-91ce-4df3216daa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:14.722474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe973766-3dbe-4dfc-8363-85edc8d9b44c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:14.757579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-31d8ae68-3571-4b73-91ce-4df3216daa1e None None] MFA Rules not processed for user `73ee3289920c44869d229d3032d8326e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:14.759306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-31d8ae68-3571-4b73-91ce-4df3216daa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:14.778355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:14.850255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:14.850988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:14.851256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:14.851538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] PATH_INFO: `/v3/projects/6b3bb5aabd384eb7ac5d0d784fa8ef6d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:14.853065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3bb5aabd384eb7ac5d0d784fa8ef6d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:14.855728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:14.882378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 982/1964] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:14.883774 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8ae68-3571-4b73-91ce-4df3216daa1e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:14.913923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8ae68-3571-4b73-91ce-4df3216daa1e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:14.939261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3bb5aabd384eb7ac5d0d784fa8ef6d', 'request_id': 'req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:14.948173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3bb5aabd384eb7ac5d0d784fa8ef6d', 'request_id': 'req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:14.960269 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3bb5aabd384eb7ac5d0d784fa8ef6d', 'request_id': 'req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:14.979570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] The token cache is being invalidate because project 6b3bb5aabd384eb7ac5d0d784fa8ef6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:14.980188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:14.981562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e49e54cd-1268-47cc-9f6e-43a90e5cb73d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:14.989392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 983/1965] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:14 2022] DELETE /identity/v3/projects/6b3bb5aabd384eb7ac5d0d784fa8ef6d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:14.992915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c67d-bc4d-4306-837b-903c4e28d4be None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:14.993749 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c67d-bc4d-4306-837b-903c4e28d4be None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:14.995157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c67d-bc4d-4306-837b-903c4e28d4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:14.995753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527dce8-a596-4eed-966b-50fa4c7fa75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:14.996476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527dce8-a596-4eed-966b-50fa4c7fa75a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:14.996828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527dce8-a596-4eed-966b-50fa4c7fa75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:14.997178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527dce8-a596-4eed-966b-50fa4c7fa75a admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:14.998235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527dce8-a596-4eed-966b-50fa4c7fa75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:15.000875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527dce8-a596-4eed-966b-50fa4c7fa75a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:15.038521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e664c67d-bc4d-4306-837b-903c4e28d4be None None] MFA Rules not processed for user `e1336475741a44b6977fc83e622c8845`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:15.039285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 983/1966] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:14 2022] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:15.040198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527dce8-a596-4eed-966b-50fa4c7fa75a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:15.042151 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6527dce8-a596-4eed-966b-50fa4c7fa75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.043478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e664c67d-bc4d-4306-837b-903c4e28d4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.054462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527dce8-a596-4eed-966b-50fa4c7fa75a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:15.059607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:15.060275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:15.060611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:15.060895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] PATH_INFO: `/v3/users/69c18c94203543f592ac6512219a2cf3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:15.062273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c18c94203543f592ac6512219a2cf3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:15.064200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:15.120013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 984/1967] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:15.120951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c67d-bc4d-4306-837b-903c4e28d4be None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:15.134121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e664c67d-bc4d-4306-837b-903c4e28d4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.140417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c18c94203543f592ac6512219a2cf3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.141637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c18c94203543f592ac6512219a2cf3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.149844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:15.156485 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c67d-bc4d-4306-837b-903c4e28d4be None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:15.161559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c18c94203543f592ac6512219a2cf3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.164579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd91fd0-b8ef-4124-b148-e48b9b5162c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:15.165219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd91fd0-b8ef-4124-b148-e48b9b5162c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:15.165932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd91fd0-b8ef-4124-b148-e48b9b5162c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:15.166929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd91fd0-b8ef-4124-b148-e48b9b5162c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:15.168482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd91fd0-b8ef-4124-b148-e48b9b5162c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:15.170938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd91fd0-b8ef-4124-b148-e48b9b5162c9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:15.180230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c18c94203543f592ac6512219a2cf3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.189067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 985/1968] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:15.190544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd91fd0-b8ef-4124-b148-e48b9b5162c9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:15.192887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7fd91fd0-b8ef-4124-b148-e48b9b5162c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.193621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c18c94203543f592ac6512219a2cf3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.207204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 984/1969] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:15 2022] DELETE /identity/v3/users/69c18c94203543f592ac6512219a2cf3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:15.207204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:15.217815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.254054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:15.351410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd91fd0-b8ef-4124-b148-e48b9b5162c9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:15.395853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d56c94-b042-4654-aa36-ef4caff77738 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:15.404493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28199325-68a4-4d52-9ab3-35b9af41935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:15.407682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28199325-68a4-4d52-9ab3-35b9af41935e admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:15.407682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28199325-68a4-4d52-9ab3-35b9af41935e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:15.407682 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28199325-68a4-4d52-9ab3-35b9af41935e admin admin] PATH_INFO: `/v3/projects/48c57797509a404aabeedfec9b3d25f6/users/544d3f8e12bc444f8011454f03114628/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:15.433836 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28199325-68a4-4d52-9ab3-35b9af41935e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c57797509a404aabeedfec9b3d25f6, user_id=544d3f8e12bc444f8011454f03114628, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:15.436649 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28199325-68a4-4d52-9ab3-35b9af41935e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:15.448672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924ba1-f6b7-400c-b65c-a2910015e34f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:15.449315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924ba1-f6b7-400c-b65c-a2910015e34f service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:15.449604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924ba1-f6b7-400c-b65c-a2910015e34f service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:15.449883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924ba1-f6b7-400c-b65c-a2910015e34f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:15.451820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2d924ba1-f6b7-400c-b65c-a2910015e34f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.454818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 985/1970] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:15 2022] PUT /identity/v3/projects/48c57797509a404aabeedfec9b3d25f6/users/544d3f8e12bc444f8011454f03114628/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:15.457091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28199325-68a4-4d52-9ab3-35b9af41935e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:15.459952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-28199325-68a4-4d52-9ab3-35b9af41935e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.530648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924ba1-f6b7-400c-b65c-a2910015e34f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:15.532544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924ba1-f6b7-400c-b65c-a2910015e34f service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:15.545478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 986/1971] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:15.546535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924ba1-f6b7-400c-b65c-a2910015e34f service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:15.557327 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924ba1-f6b7-400c-b65c-a2910015e34f service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:15.598388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:15.598642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28199325-68a4-4d52-9ab3-35b9af41935e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:15.604665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:15.605559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:15.605907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:15.606459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] PATH_INFO: `/v3/users/b2a31f93f257436195aba2de90dbb163` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:15.607757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a31f93f257436195aba2de90dbb163)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:15.614002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:15.650471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3bdd1-cc34-48af-8afb-ee0bfa5c5caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:15.650471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3bdd1-cc34-48af-8afb-ee0bfa5c5caf admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:15.650678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3bdd1-cc34-48af-8afb-ee0bfa5c5caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:15.650961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3bdd1-cc34-48af-8afb-ee0bfa5c5caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:15.652230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3bdd1-cc34-48af-8afb-ee0bfa5c5caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:15.654724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3bdd1-cc34-48af-8afb-ee0bfa5c5caf admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:15.676613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 987/1972] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:15.678087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3bdd1-cc34-48af-8afb-ee0bfa5c5caf admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:15.682314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4ef3bdd1-cc34-48af-8afb-ee0bfa5c5caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.701892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3bdd1-cc34-48af-8afb-ee0bfa5c5caf admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:15.711775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:15.711775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:15.712049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:15.712412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] PATH_INFO: `/v3/projects/e61716112bbb436ea6df271a2889c732` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:15.713616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61716112bbb436ea6df271a2889c732)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:15.715945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:15.717288 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a31f93f257436195aba2de90dbb163'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.718684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a31f93f257436195aba2de90dbb163'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.735439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a31f93f257436195aba2de90dbb163'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.758910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a31f93f257436195aba2de90dbb163'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.768239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a31f93f257436195aba2de90dbb163'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.776147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 986/1973] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:15 2022] DELETE /identity/v3/users/b2a31f93f257436195aba2de90dbb163 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:15.777344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:15.779130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.791808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61716112bbb436ea6df271a2889c732', 'request_id': 'req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.795529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:15.801312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61716112bbb436ea6df271a2889c732', 'request_id': 'req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.810338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61716112bbb436ea6df271a2889c732', 'request_id': 'req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.837100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] The token cache is being invalidate because project e61716112bbb436ea6df271a2889c732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:15.837552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.838284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-87eb8de6-f2aa-4369-b0e9-cba6bf50a0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:15.841260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 988/1974] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:15 2022] DELETE /identity/v3/projects/e61716112bbb436ea6df271a2889c732 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:15.842154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d0f2e-aca1-4bb6-a514-ada24d4d3668 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:15.842154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d0f2e-aca1-4bb6-a514-ada24d4d3668 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:15.842328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d0f2e-aca1-4bb6-a514-ada24d4d3668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:15.869582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a61d0f2e-aca1-4bb6-a514-ada24d4d3668 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:15.870882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a61d0f2e-aca1-4bb6-a514-ada24d4d3668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.881695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1c16d-d011-44af-915f-c63c418de305 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:15.895045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 989/1975] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:15.895867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034b679-42af-41d7-8988-2e1e308704ce None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:15.896171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034b679-42af-41d7-8988-2e1e308704ce None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:15.896798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034b679-42af-41d7-8988-2e1e308704ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:15.901036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a1b56-5875-4dc9-b225-1f44331918ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:15.901839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a1b56-5875-4dc9-b225-1f44331918ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:15.902478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a1b56-5875-4dc9-b225-1f44331918ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:15.902762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a1b56-5875-4dc9-b225-1f44331918ad admin admin] PATH_INFO: `/v3/projects/48c57797509a404aabeedfec9b3d25f6/users/544d3f8e12bc444f8011454f03114628/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:15.907263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a1b56-5875-4dc9-b225-1f44331918ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c57797509a404aabeedfec9b3d25f6, user_id=544d3f8e12bc444f8011454f03114628, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:15.910721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a1b56-5875-4dc9-b225-1f44331918ad admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:15.918254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3034b679-42af-41d7-8988-2e1e308704ce None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:15.919484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3034b679-42af-41d7-8988-2e1e308704ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:15.921939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 987/1976] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:15 2022] PUT /identity/v3/projects/48c57797509a404aabeedfec9b3d25f6/users/544d3f8e12bc444f8011454f03114628/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:15.922706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a1b56-5875-4dc9-b225-1f44331918ad admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:15.932712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bf9a1b56-5875-4dc9-b225-1f44331918ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:16.032661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 990/1977] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:16.036070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc1a45-34bc-4121-b1fa-591bd094bfe3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.038370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc1a45-34bc-4121-b1fa-591bd094bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.038694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc1a45-34bc-4121-b1fa-591bd094bfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.074224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a1b56-5875-4dc9-b225-1f44331918ad admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:16.084418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb450b-86fc-4acb-a71a-b15300f141aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:16.086711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb450b-86fc-4acb-a71a-b15300f141aa service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.087646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb450b-86fc-4acb-a71a-b15300f141aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.087876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb450b-86fc-4acb-a71a-b15300f141aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.111463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-02cc1a45-34bc-4121-b1fa-591bd094bfe3 None None] MFA Rules not processed for user `544d3f8e12bc444f8011454f03114628`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:16.113678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-02cc1a45-34bc-4121-b1fa-591bd094bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:16.121658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb450b-86fc-4acb-a71a-b15300f141aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:16.124620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb450b-86fc-4acb-a71a-b15300f141aa service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:16.146561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 988/1978] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:16.147952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0379df-dac9-4ea2-beb9-d7ebab9e2df7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.148316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0379df-dac9-4ea2-beb9-d7ebab9e2df7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.148714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0379df-dac9-4ea2-beb9-d7ebab9e2df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.174980 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:16.182485 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5a0379df-dac9-4ea2-beb9-d7ebab9e2df7 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:16.184702 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5a0379df-dac9-4ea2-beb9-d7ebab9e2df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:16.208504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 989/1979] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:16.214068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0379df-dac9-4ea2-beb9-d7ebab9e2df7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:16.231997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0379df-dac9-4ea2-beb9-d7ebab9e2df7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:16.240555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec4746-37fd-4234-9987-13837a7f89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:16.241694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec4746-37fd-4234-9987-13837a7f89f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.242160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec4746-37fd-4234-9987-13837a7f89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.242724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec4746-37fd-4234-9987-13837a7f89f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.243565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec4746-37fd-4234-9987-13837a7f89f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:16.244407 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec4746-37fd-4234-9987-13837a7f89f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:16.247314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec4746-37fd-4234-9987-13837a7f89f7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:16.255884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 991/1980] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:16.273754 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc1a45-34bc-4121-b1fa-591bd094bfe3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:16.275424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-02cc1a45-34bc-4121-b1fa-591bd094bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:16.282197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 990/1981] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:16.285526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec4746-37fd-4234-9987-13837a7f89f7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:16.303445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec4746-37fd-4234-9987-13837a7f89f7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:16.310373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82f4f2-db44-478d-abca-43f0d2bf5ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:16.311022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82f4f2-db44-478d-abca-43f0d2bf5ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.311310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82f4f2-db44-478d-abca-43f0d2bf5ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.311594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82f4f2-db44-478d-abca-43f0d2bf5ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.312283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82f4f2-db44-478d-abca-43f0d2bf5ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:16.314239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82f4f2-db44-478d-abca-43f0d2bf5ca2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:16.378946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 991/1982] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:16 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:16.383899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82f4f2-db44-478d-abca-43f0d2bf5ca2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:16.410411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc1a45-34bc-4121-b1fa-591bd094bfe3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:16.498473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaa9b6-8d21-4b03-a2a1-9cf36d8460cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:16.499573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaa9b6-8d21-4b03-a2a1-9cf36d8460cf service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.500006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaa9b6-8d21-4b03-a2a1-9cf36d8460cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.500949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaa9b6-8d21-4b03-a2a1-9cf36d8460cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.548311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82f4f2-db44-478d-abca-43f0d2bf5ca2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:16.558843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59577-160a-492b-83ea-b39963321836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:16.559533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59577-160a-492b-83ea-b39963321836 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.559917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59577-160a-492b-83ea-b39963321836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.560260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59577-160a-492b-83ea-b39963321836 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.561108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb59577-160a-492b-83ea-b39963321836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:16.564500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb59577-160a-492b-83ea-b39963321836 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:16.592504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:16.604840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaa9b6-8d21-4b03-a2a1-9cf36d8460cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:16.607676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaa9b6-8d21-4b03-a2a1-9cf36d8460cf service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:16.611825 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 992/1983] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:16 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:16.616060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59577-160a-492b-83ea-b39963321836 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:16.626237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 992/1984] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:09:16.632817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59577-160a-492b-83ea-b39963321836 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:16.644358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab95165-a600-461a-99da-1bd484d4456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:16.645113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab95165-a600-461a-99da-1bd484d4456b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.645459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab95165-a600-461a-99da-1bd484d4456b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.645801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab95165-a600-461a-99da-1bd484d4456b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.646531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab95165-a600-461a-99da-1bd484d4456b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:16.648246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab95165-a600-461a-99da-1bd484d4456b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:16.664301 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 993/1985] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:16.665583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaa9b6-8d21-4b03-a2a1-9cf36d8460cf service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:16.682358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaa9b6-8d21-4b03-a2a1-9cf36d8460cf service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:16.697353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4bca1-5849-49bf-b020-181972eb21f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:16.698213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4bca1-5849-49bf-b020-181972eb21f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.698507 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4bca1-5849-49bf-b020-181972eb21f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.698790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4bca1-5849-49bf-b020-181972eb21f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.699457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4bca1-5849-49bf-b020-181972eb21f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:16.701812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4bca1-5849-49bf-b020-181972eb21f7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:16.716866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 993/1986] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:16.721163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab95165-a600-461a-99da-1bd484d4456b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:16.755117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab95165-a600-461a-99da-1bd484d4456b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:16.756375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4bca1-5849-49bf-b020-181972eb21f7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:16.764151 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66da3b3-0bba-4196-a928-1370051ebe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:16.765330 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66da3b3-0bba-4196-a928-1370051ebe6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.765646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66da3b3-0bba-4196-a928-1370051ebe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.766037 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66da3b3-0bba-4196-a928-1370051ebe6a admin admin] PATH_INFO: `/v3/projects/50f3905453a5474ca07b25041549fe75/users/5117e079ddfb46de857bb997be7145b3/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.788649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4bca1-5849-49bf-b020-181972eb21f7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:16.793081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90bf32-737a-48cd-800a-45e42fdbadff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:16.794890 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90bf32-737a-48cd-800a-45e42fdbadff service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.795648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90bf32-737a-48cd-800a-45e42fdbadff service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.796177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90bf32-737a-48cd-800a-45e42fdbadff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.798239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2d90bf32-737a-48cd-800a-45e42fdbadff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:16.811447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66da3b3-0bba-4196-a928-1370051ebe6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f3905453a5474ca07b25041549fe75, user_id=5117e079ddfb46de857bb997be7145b3, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:16.815516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66da3b3-0bba-4196-a928-1370051ebe6a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:16.843655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 994/1987] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:16 2022] PUT /identity/v3/projects/50f3905453a5474ca07b25041549fe75/users/5117e079ddfb46de857bb997be7145b3/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:16.859139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66da3b3-0bba-4196-a928-1370051ebe6a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:16.868496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d66da3b3-0bba-4196-a928-1370051ebe6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:16.869247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:16.939166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90bf32-737a-48cd-800a-45e42fdbadff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:16.941781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90bf32-737a-48cd-800a-45e42fdbadff service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:16.954210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 994/1988] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:09:16.956371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f368614-36c6-4d29-b936-c5cdbb2cd5c0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.957052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f368614-36c6-4d29-b936-c5cdbb2cd5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.957377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f368614-36c6-4d29-b936-c5cdbb2cd5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.958813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66da3b3-0bba-4196-a928-1370051ebe6a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:16.980850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:16.980850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:16.980850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:16.980850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] PATH_INFO: `/v3/projects/5a420e29d0ce4ba8adb30477458e5f7a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:16.981256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a420e29d0ce4ba8adb30477458e5f7a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:16.981256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:16.989994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4f368614-36c6-4d29-b936-c5cdbb2cd5c0 None None] MFA Rules not processed for user `5117e079ddfb46de857bb997be7145b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:16.991259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4f368614-36c6-4d29-b936-c5cdbb2cd5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:17.047656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a420e29d0ce4ba8adb30477458e5f7a', 'request_id': 'req-b0e9958a-ebf9-44ea-9045-5d6b7706940d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.083037 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a420e29d0ce4ba8adb30477458e5f7a', 'request_id': 'req-b0e9958a-ebf9-44ea-9045-5d6b7706940d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.104201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a420e29d0ce4ba8adb30477458e5f7a', 'request_id': 'req-b0e9958a-ebf9-44ea-9045-5d6b7706940d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.125403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 995/1989] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:17.125596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] The token cache is being invalidate because project 5a420e29d0ce4ba8adb30477458e5f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:17.125596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.125773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.132631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 995/1990] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:16 2022] DELETE /identity/v3/projects/5a420e29d0ce4ba8adb30477458e5f7a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:17.134169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f368614-36c6-4d29-b936-c5cdbb2cd5c0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:17.137786 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:17.138569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:17.160113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f368614-36c6-4d29-b936-c5cdbb2cd5c0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:17.228672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:17.261703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a0922-d032-4522-8405-d9900f86d5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:17.262707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a0922-d032-4522-8405-d9900f86d5fc admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:17.263283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a0922-d032-4522-8405-d9900f86d5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:17.263613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a0922-d032-4522-8405-d9900f86d5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:17.264272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a0922-d032-4522-8405-d9900f86d5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:17.268790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a0922-d032-4522-8405-d9900f86d5fc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:17.269758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9958a-ebf9-44ea-9045-5d6b7706940d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:17.276453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:17.277343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:17.277723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:17.278097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] PATH_INFO: `/v3/users/a0b75c753c39414991fe365588c68461` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:17.293659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b75c753c39414991fe365588c68461)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:17.297995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:17.328597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 996/1991] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:17 2022] POST /identity/v3/projects => generated 369 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:17.332880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a0922-d032-4522-8405-d9900f86d5fc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:17.337984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9b4a0922-d032-4522-8405-d9900f86d5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:17.409334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b75c753c39414991fe365588c68461'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.410092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b75c753c39414991fe365588c68461'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.419625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b75c753c39414991fe365588c68461'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.437937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b75c753c39414991fe365588c68461'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.438734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:17.453843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b75c753c39414991fe365588c68461'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.464467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 996/1992] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:17 2022] DELETE /identity/v3/users/a0b75c753c39414991fe365588c68461 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:17.465260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:17.466707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:17.481999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a0922-d032-4522-8405-d9900f86d5fc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:17.561628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f8a09-1f96-46d4-b658-d9115aefd116 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:17.570062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:17.571083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:17.571509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:17.571984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] PATH_INFO: `/v3/users/001c04d83032419d8cc233c18103a248` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:17.573720 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001c04d83032419d8cc233c18103a248)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:17.575125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b5f80-c798-4eb8-9627-c69363301bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:17.575917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b5f80-c798-4eb8-9627-c69363301bae admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:17.576413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:17.576748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b5f80-c798-4eb8-9627-c69363301bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:17.577130 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b5f80-c798-4eb8-9627-c69363301bae admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:17.578049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b5f80-c798-4eb8-9627-c69363301bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:17.580469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b5f80-c798-4eb8-9627-c69363301bae admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:17.633742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 997/1993] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:17 2022] POST /identity/v3/users => generated 291 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:17.633742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b5f80-c798-4eb8-9627-c69363301bae admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:17.635183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ad6b5f80-c798-4eb8-9627-c69363301bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:17.652728 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001c04d83032419d8cc233c18103a248'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.655064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001c04d83032419d8cc233c18103a248'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.667651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001c04d83032419d8cc233c18103a248'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.668142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b5f80-c798-4eb8-9627-c69363301bae admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:17.680801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:17.681749 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:17.682144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:17.682608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] PATH_INFO: `/v3/users/a9a35e99c8c342a2ba2821429f3e5422` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:17.686822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a35e99c8c342a2ba2821429f3e5422)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:17.687552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:17.689361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001c04d83032419d8cc233c18103a248'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.692852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:17.702527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001c04d83032419d8cc233c18103a248'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.712966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 997/1994] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:17 2022] DELETE /identity/v3/users/001c04d83032419d8cc233c18103a248 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:17.713939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:17.715989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:17.833077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a35e99c8c342a2ba2821429f3e5422'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.834724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a35e99c8c342a2ba2821429f3e5422'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.838404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307bbb-1c3f-4e39-9907-98090f70ebc9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:17.847577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231dcf-4096-4809-9939-508ff765d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:17.848540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231dcf-4096-4809-9939-508ff765d0ee admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:17.848843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231dcf-4096-4809-9939-508ff765d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:17.849269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231dcf-4096-4809-9939-508ff765d0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:17.850397 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f231dcf-4096-4809-9939-508ff765d0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:17.852594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a35e99c8c342a2ba2821429f3e5422'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.862431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a35e99c8c342a2ba2821429f3e5422'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.871622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f231dcf-4096-4809-9939-508ff765d0ee admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:17.892288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a35e99c8c342a2ba2821429f3e5422'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:17.898408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 998/1995] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:17.900654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919b1a-672d-4fe5-93f1-cf116b989d14 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:17.904845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919b1a-672d-4fe5-93f1-cf116b989d14 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:17.904999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919b1a-672d-4fe5-93f1-cf116b989d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:17.905363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 998/1996] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:17 2022] DELETE /identity/v3/users/a9a35e99c8c342a2ba2821429f3e5422 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:17.907007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:17.913737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:17.936086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-60919b1a-672d-4fe5-93f1-cf116b989d14 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:17.937492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-60919b1a-672d-4fe5-93f1-cf116b989d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:17.991090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:18.048651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3308f5-5ae2-400e-bd8a-88eb4d700a97 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.053597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 999/1997] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:18.055228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accfa67-b380-4c36-b505-f64606061f41 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.055673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accfa67-b380-4c36-b505-f64606061f41 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.056102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accfa67-b380-4c36-b505-f64606061f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.062053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e8351-06e2-4d62-a1e2-f45a9a753674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.063299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e8351-06e2-4d62-a1e2-f45a9a753674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.063735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e8351-06e2-4d62-a1e2-f45a9a753674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.064356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e8351-06e2-4d62-a1e2-f45a9a753674 admin admin] PATH_INFO: `/v3/projects/77a90d75169a47c381cd6323e9d2a420/users/1b647ec47ef94167908f9557540a1cce/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.077509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2accfa67-b380-4c36-b505-f64606061f41 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:18.078988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2accfa67-b380-4c36-b505-f64606061f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:18.087117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e8351-06e2-4d62-a1e2-f45a9a753674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a90d75169a47c381cd6323e9d2a420, user_id=1b647ec47ef94167908f9557540a1cce, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:18.089910 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e8351-06e2-4d62-a1e2-f45a9a753674 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:18.090123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1000/1998] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:18.091611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accfa67-b380-4c36-b505-f64606061f41 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.098468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2accfa67-b380-4c36-b505-f64606061f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:18.107212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 999/1999] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:17 2022] PUT /identity/v3/projects/77a90d75169a47c381cd6323e9d2a420/users/1b647ec47ef94167908f9557540a1cce/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:18.108286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e8351-06e2-4d62-a1e2-f45a9a753674 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.110356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-988e8351-06e2-4d62-a1e2-f45a9a753674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:18.112423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accfa67-b380-4c36-b505-f64606061f41 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.188933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e8351-06e2-4d62-a1e2-f45a9a753674 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.193647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70091f-b23d-4860-882c-2fb37ba87e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.194464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70091f-b23d-4860-882c-2fb37ba87e88 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.194855 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70091f-b23d-4860-882c-2fb37ba87e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.195017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.195451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70091f-b23d-4860-882c-2fb37ba87e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.195677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.195964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.196343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] PATH_INFO: `/v3/projects/0f9fadd487a64632844a35413d668bad` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.197527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9fadd487a64632844a35413d668bad)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:18.200022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:18.206871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70091f-b23d-4860-882c-2fb37ba87e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:18.209390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70091f-b23d-4860-882c-2fb37ba87e88 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:18.220539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1000/2000] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:18.221811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70091f-b23d-4860-882c-2fb37ba87e88 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.227559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:18.235064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70091f-b23d-4860-882c-2fb37ba87e88 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.242159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208237fa-258e-4fdd-b2af-264e058eb4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.242997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208237fa-258e-4fdd-b2af-264e058eb4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.243527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208237fa-258e-4fdd-b2af-264e058eb4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.243921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208237fa-258e-4fdd-b2af-264e058eb4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.262390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208237fa-258e-4fdd-b2af-264e058eb4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:18.264783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208237fa-258e-4fdd-b2af-264e058eb4f3 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:18.269892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9fadd487a64632844a35413d668bad', 'request_id': 'req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:18.281226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9fadd487a64632844a35413d668bad', 'request_id': 'req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:18.282921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1001/2001] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:18.284581 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208237fa-258e-4fdd-b2af-264e058eb4f3 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.294270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9fadd487a64632844a35413d668bad', 'request_id': 'req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:18.296094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208237fa-258e-4fdd-b2af-264e058eb4f3 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.318523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] The token cache is being invalidate because project 0f9fadd487a64632844a35413d668bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:18.319204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:18.320567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf6bafec-4e61-44c5-a8b8-4202a1c4dfa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:18.323564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1001/2002] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:18 2022] DELETE /identity/v3/projects/0f9fadd487a64632844a35413d668bad => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:18.331623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9093b-20a2-429d-85ee-2dc7e34f13a0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.332115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9093b-20a2-429d-85ee-2dc7e34f13a0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.332824 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9093b-20a2-429d-85ee-2dc7e34f13a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.380002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bba9093b-20a2-429d-85ee-2dc7e34f13a0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:18.381707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bba9093b-20a2-429d-85ee-2dc7e34f13a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:18.389178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c50a0-8400-444c-a3de-d20790c218aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.389911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c50a0-8400-444c-a3de-d20790c218aa admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.390299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c50a0-8400-444c-a3de-d20790c218aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.390644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c50a0-8400-444c-a3de-d20790c218aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.391372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c50a0-8400-444c-a3de-d20790c218aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:18.393970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c50a0-8400-444c-a3de-d20790c218aa admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:18.405462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1002/2003] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:18.410427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c50a0-8400-444c-a3de-d20790c218aa admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.412794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-171c50a0-8400-444c-a3de-d20790c218aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:18.429288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c50a0-8400-444c-a3de-d20790c218aa admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.435647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762d47-1a52-4ede-8849-f8128a3c7af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.438367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762d47-1a52-4ede-8849-f8128a3c7af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.438760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762d47-1a52-4ede-8849-f8128a3c7af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.439104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762d47-1a52-4ede-8849-f8128a3c7af5 admin admin] PATH_INFO: `/v3/projects/77a90d75169a47c381cd6323e9d2a420/users/1b647ec47ef94167908f9557540a1cce/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.445185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762d47-1a52-4ede-8849-f8128a3c7af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a90d75169a47c381cd6323e9d2a420, user_id=1b647ec47ef94167908f9557540a1cce, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:18.448164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762d47-1a52-4ede-8849-f8128a3c7af5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:18.460619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1003/2004] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:18 2022] PUT /identity/v3/projects/77a90d75169a47c381cd6323e9d2a420/users/1b647ec47ef94167908f9557540a1cce/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:18.472839 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166990-553a-4da4-b885-f589f13e9eae None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.473647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166990-553a-4da4-b885-f589f13e9eae None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.474361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166990-553a-4da4-b885-f589f13e9eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.482999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1002/2005] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:18.492965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be593-95bf-4264-85d4-d8b88bf344f8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.493384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be593-95bf-4264-85d4-d8b88bf344f8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.494569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be593-95bf-4264-85d4-d8b88bf344f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.514945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-87166990-553a-4da4-b885-f589f13e9eae None None] MFA Rules not processed for user `1b647ec47ef94167908f9557540a1cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:18.516682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-87166990-553a-4da4-b885-f589f13e9eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:18.519773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d06be593-95bf-4264-85d4-d8b88bf344f8 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:18.522599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d06be593-95bf-4264-85d4-d8b88bf344f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:18.555132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:18.616150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1003/2006] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:18.621109 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06be593-95bf-4264-85d4-d8b88bf344f8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.634469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1004/2007] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:18.639320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06be593-95bf-4264-85d4-d8b88bf344f8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.642362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87166990-553a-4da4-b885-f589f13e9eae None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.645568 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-87166990-553a-4da4-b885-f589f13e9eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:18.652088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114367-c378-4537-80cd-e5983fa539cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.652999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114367-c378-4537-80cd-e5983fa539cf admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.653488 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114367-c378-4537-80cd-e5983fa539cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.654008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114367-c378-4537-80cd-e5983fa539cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.654878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e114367-c378-4537-80cd-e5983fa539cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:18.655402 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e114367-c378-4537-80cd-e5983fa539cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:18.661551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e114367-c378-4537-80cd-e5983fa539cf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:18.695504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1004/2008] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:09:18.699788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114367-c378-4537-80cd-e5983fa539cf admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.716504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114367-c378-4537-80cd-e5983fa539cf admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.734551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37338e-81e5-4def-a07d-7b981e37394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.735924 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37338e-81e5-4def-a07d-7b981e37394a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.736209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37338e-81e5-4def-a07d-7b981e37394a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.736568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37338e-81e5-4def-a07d-7b981e37394a admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.738262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37338e-81e5-4def-a07d-7b981e37394a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:18.741015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37338e-81e5-4def-a07d-7b981e37394a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:18.771960 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87166990-553a-4da4-b885-f589f13e9eae None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.779021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50199fa-f84b-4cea-8b4c-0e91bbd26fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.779791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50199fa-f84b-4cea-8b4c-0e91bbd26fda service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.780075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50199fa-f84b-4cea-8b4c-0e91bbd26fda service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.780452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50199fa-f84b-4cea-8b4c-0e91bbd26fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.780916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1005/2009] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:18 2022] POST /identity/v3/projects => generated 407 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:18.785134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37338e-81e5-4def-a07d-7b981e37394a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.813811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50199fa-f84b-4cea-8b4c-0e91bbd26fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:18.817176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:18.818477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50199fa-f84b-4cea-8b4c-0e91bbd26fda service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:18.836988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1005/2010] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:09:18.913420 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50199fa-f84b-4cea-8b4c-0e91bbd26fda service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.915142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e50199fa-f84b-4cea-8b4c-0e91bbd26fda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:18.928432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50199fa-f84b-4cea-8b4c-0e91bbd26fda service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.929507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37338e-81e5-4def-a07d-7b981e37394a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.934953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ab14d-a745-429c-9731-2cf5890ad20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.935895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ab14d-a745-429c-9731-2cf5890ad20e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.936186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ab14d-a745-429c-9731-2cf5890ad20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.936640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ab14d-a745-429c-9731-2cf5890ad20e admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:18.937427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ab14d-a745-429c-9731-2cf5890ad20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:18.941847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ab14d-a745-429c-9731-2cf5890ad20e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:18.971127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1006/2011] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:18 2022] POST /identity/v3/users => generated 304 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:18.975039 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ab14d-a745-429c-9731-2cf5890ad20e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:18.989156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ab14d-a745-429c-9731-2cf5890ad20e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:18.996312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451eb5c-7d02-42fd-93bb-e3aac7840ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:18.996966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451eb5c-7d02-42fd-93bb-e3aac7840ebc service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:18.997255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451eb5c-7d02-42fd-93bb-e3aac7840ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:18.998497 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451eb5c-7d02-42fd-93bb-e3aac7840ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:19.001033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a45595-ca2e-4b76-a0b3-ea3cc228fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:19.001676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a45595-ca2e-4b76-a0b3-ea3cc228fd92 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:19.001937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a45595-ca2e-4b76-a0b3-ea3cc228fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:19.002216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a45595-ca2e-4b76-a0b3-ea3cc228fd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:19.003842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a45595-ca2e-4b76-a0b3-ea3cc228fd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:19.006311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8451eb5c-7d02-42fd-93bb-e3aac7840ebc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:19.009657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a45595-ca2e-4b76-a0b3-ea3cc228fd92 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:19.031068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1007/2012] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:19.032477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a45595-ca2e-4b76-a0b3-ea3cc228fd92 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:19.046459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a45595-ca2e-4b76-a0b3-ea3cc228fd92 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:19.054121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5baf50-3f38-4ea2-b5fa-46b785678540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:19.055779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5baf50-3f38-4ea2-b5fa-46b785678540 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:19.056149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5baf50-3f38-4ea2-b5fa-46b785678540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:19.056548 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5baf50-3f38-4ea2-b5fa-46b785678540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:19.057272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5baf50-3f38-4ea2-b5fa-46b785678540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:19.060375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5baf50-3f38-4ea2-b5fa-46b785678540 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:19.081662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1008/2013] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:19.083212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5baf50-3f38-4ea2-b5fa-46b785678540 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:19.132188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5baf50-3f38-4ea2-b5fa-46b785678540 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:19.146562 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d170-3179-42ec-bf0f-7f2c3873465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:19.148061 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d170-3179-42ec-bf0f-7f2c3873465e admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:19.149086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d170-3179-42ec-bf0f-7f2c3873465e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:19.149614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d170-3179-42ec-bf0f-7f2c3873465e admin admin] PATH_INFO: `/v3/projects/b86f3468b8934957b159584f54ea85b3/users/9080ee05860946189836eaf7910f0048/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:19.175105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451eb5c-7d02-42fd-93bb-e3aac7840ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:19.177033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451eb5c-7d02-42fd-93bb-e3aac7840ebc service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:19.185829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2d170-3179-42ec-bf0f-7f2c3873465e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86f3468b8934957b159584f54ea85b3, user_id=9080ee05860946189836eaf7910f0048, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:19.193753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2d170-3179-42ec-bf0f-7f2c3873465e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:19.196723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1006/2014] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:19.231715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1009/2015] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:19 2022] PUT /identity/v3/projects/b86f3468b8934957b159584f54ea85b3/users/9080ee05860946189836eaf7910f0048/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:19.242759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78e087-032f-4af9-bcf8-d3395af9ce3d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:19.243052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78e087-032f-4af9-bcf8-d3395af9ce3d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:19.243336 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78e087-032f-4af9-bcf8-d3395af9ce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:19.281184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-eb78e087-032f-4af9-bcf8-d3395af9ce3d None None] MFA Rules not processed for user `9080ee05860946189836eaf7910f0048`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:19.282807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eb78e087-032f-4af9-bcf8-d3395af9ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:19.293947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:19.333831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d170-3179-42ec-bf0f-7f2c3873465e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:19.336645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1dc2d170-3179-42ec-bf0f-7f2c3873465e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:19.497304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1007/2016] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:19.503178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78e087-032f-4af9-bcf8-d3395af9ce3d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:19.505146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eb78e087-032f-4af9-bcf8-d3395af9ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:19.537913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d170-3179-42ec-bf0f-7f2c3873465e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:19.544036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:19.544916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:19.545275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:19.545647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] PATH_INFO: `/v3/projects/e3242440eddd40e18100ef9831430b64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:19.546970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3242440eddd40e18100ef9831430b64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:19.549842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:19.640091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3242440eddd40e18100ef9831430b64', 'request_id': 'req-0666813e-29e0-45cb-83eb-a1a63ba275f9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:19.645181 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78e087-032f-4af9-bcf8-d3395af9ce3d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:19.654180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3242440eddd40e18100ef9831430b64', 'request_id': 'req-0666813e-29e0-45cb-83eb-a1a63ba275f9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:19.656459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:19.670684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3242440eddd40e18100ef9831430b64', 'request_id': 'req-0666813e-29e0-45cb-83eb-a1a63ba275f9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:19.692593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] The token cache is being invalidate because project e3242440eddd40e18100ef9831430b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:19.692593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:19.693878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:19.697098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1010/2017] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:19 2022] DELETE /identity/v3/projects/e3242440eddd40e18100ef9831430b64 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:19.697965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:19.704095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:19.745442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:19.746098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:19.746504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:19.746713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] PATH_INFO: `/v3/projects/c4b0cb83511b4ee7a26c929858e9cccf` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:19.748958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b0cb83511b4ee7a26c929858e9cccf)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:19.754084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:19.824303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666813e-29e0-45cb-83eb-a1a63ba275f9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:19.836465 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b0cb83511b4ee7a26c929858e9cccf', 'request_id': 'req-0da3465c-54ad-44a3-9658-765af28259dc'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:19.843482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b0cb83511b4ee7a26c929858e9cccf', 'request_id': 'req-0da3465c-54ad-44a3-9658-765af28259dc'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:19.846653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:19.852226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b0cb83511b4ee7a26c929858e9cccf', 'request_id': 'req-0da3465c-54ad-44a3-9658-765af28259dc'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:19.874452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] The token cache is being invalidate because project c4b0cb83511b4ee7a26c929858e9cccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:19.874924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:19.875909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0da3465c-54ad-44a3-9658-765af28259dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:19.879490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1008/2018] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:19 2022] DELETE /identity/v3/projects/c4b0cb83511b4ee7a26c929858e9cccf => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:19.884505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4ad5f-cfd1-4c2c-b51a-61d034b9fdd5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:19.884736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4ad5f-cfd1-4c2c-b51a-61d034b9fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:19.885134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4ad5f-cfd1-4c2c-b51a-61d034b9fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:19.904983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65001f7a-87fe-4a17-bd98-b2438ea46ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:19.905690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001f7a-87fe-4a17-bd98-b2438ea46ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:19.905984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001f7a-87fe-4a17-bd98-b2438ea46ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:19.906265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001f7a-87fe-4a17-bd98-b2438ea46ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:19.906929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65001f7a-87fe-4a17-bd98-b2438ea46ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:19.910313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65001f7a-87fe-4a17-bd98-b2438ea46ee1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:19.918046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5af4ad5f-cfd1-4c2c-b51a-61d034b9fdd5 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:19.919355 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5af4ad5f-cfd1-4c2c-b51a-61d034b9fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:19.930087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1009/2019] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:19.931006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4ad5f-cfd1-4c2c-b51a-61d034b9fdd5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:19.933470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5af4ad5f-cfd1-4c2c-b51a-61d034b9fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:19.947852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4ad5f-cfd1-4c2c-b51a-61d034b9fdd5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:19.950068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1011/2020] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:19 2022] POST /identity/v3/projects => generated 409 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:19.951409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa063f-3686-4c81-a1aa-73402ac79aca None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:19.951709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa063f-3686-4c81-a1aa-73402ac79aca None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:19.952829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa063f-3686-4c81-a1aa-73402ac79aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:19.980022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-44fa063f-3686-4c81-a1aa-73402ac79aca None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:19.981508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-44fa063f-3686-4c81-a1aa-73402ac79aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:20.037882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.039037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.039194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.039478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] PATH_INFO: `/v3/users/544d3f8e12bc444f8011454f03114628` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.041001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544d3f8e12bc444f8011454f03114628)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.042657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.061500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1012/2021] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:20.062292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa063f-3686-4c81-a1aa-73402ac79aca None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.063662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-44fa063f-3686-4c81-a1aa-73402ac79aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:20.076766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa063f-3686-4c81-a1aa-73402ac79aca None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.083397 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f451da8-96fd-4092-a99c-ee90948be504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.084033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f451da8-96fd-4092-a99c-ee90948be504 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.084296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f451da8-96fd-4092-a99c-ee90948be504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.084608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f451da8-96fd-4092-a99c-ee90948be504 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.085252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f451da8-96fd-4092-a99c-ee90948be504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.087187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f451da8-96fd-4092-a99c-ee90948be504 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.111106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544d3f8e12bc444f8011454f03114628'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:20.112661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544d3f8e12bc444f8011454f03114628'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:20.117291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1013/2022] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:20 2022] POST /identity/v3/users => generated 311 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:20.121137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f451da8-96fd-4092-a99c-ee90948be504 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.122648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544d3f8e12bc444f8011454f03114628'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:20.132886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3f451da8-96fd-4092-a99c-ee90948be504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:20.135052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544d3f8e12bc444f8011454f03114628'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:20.140754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:20.150233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f451da8-96fd-4092-a99c-ee90948be504 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.155490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544d3f8e12bc444f8011454f03114628'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:20.159419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dea5a-18b1-460b-b000-eba877e6d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.160042 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dea5a-18b1-460b-b000-eba877e6d6ee admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.160356 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dea5a-18b1-460b-b000-eba877e6d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.160773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dea5a-18b1-460b-b000-eba877e6d6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.161496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dea5a-18b1-460b-b000-eba877e6d6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:20.161811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dea5a-18b1-460b-b000-eba877e6d6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.164007 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dea5a-18b1-460b-b000-eba877e6d6ee admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.165236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1010/2023] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:19 2022] DELETE /identity/v3/users/544d3f8e12bc444f8011454f03114628 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:20.169392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.171161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:20.182111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1014/2024] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:20.183300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dea5a-18b1-460b-b000-eba877e6d6ee admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.198499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dea5a-18b1-460b-b000-eba877e6d6ee admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.288877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83109b1-5338-42bb-b4db-0fe153b5ca15 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.291627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46eac9-3b2e-4924-b65e-dddb29a9bbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.292300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46eac9-3b2e-4924-b65e-dddb29a9bbbd admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.292698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46eac9-3b2e-4924-b65e-dddb29a9bbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.292979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46eac9-3b2e-4924-b65e-dddb29a9bbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.293725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46eac9-3b2e-4924-b65e-dddb29a9bbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.296481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46eac9-3b2e-4924-b65e-dddb29a9bbbd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.305696 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954423b6-c6e3-4a18-a56f-21585078e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.306405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954423b6-c6e3-4a18-a56f-21585078e871 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.306717 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954423b6-c6e3-4a18-a56f-21585078e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.306991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954423b6-c6e3-4a18-a56f-21585078e871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.307736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954423b6-c6e3-4a18-a56f-21585078e871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.310247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954423b6-c6e3-4a18-a56f-21585078e871 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.322080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:20.331892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1011/2025] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:20.336603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954423b6-c6e3-4a18-a56f-21585078e871 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.352221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954423b6-c6e3-4a18-a56f-21585078e871 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.359212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1015/2026] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:20 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:20.363774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08acd58-1de2-48ed-a0a9-5b22513d5f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.365741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46eac9-3b2e-4924-b65e-dddb29a9bbbd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.366301 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08acd58-1de2-48ed-a0a9-5b22513d5f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.368548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08acd58-1de2-48ed-a0a9-5b22513d5f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.368846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08acd58-1de2-48ed-a0a9-5b22513d5f72 admin admin] PATH_INFO: `/v3/projects/1dca922ee56646caa3c5c64e76be1c75/users/2bd72a7d59aa40588e58860196c5ea13/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.394223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08acd58-1de2-48ed-a0a9-5b22513d5f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dca922ee56646caa3c5c64e76be1c75, user_id=2bd72a7d59aa40588e58860196c5ea13, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.400216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08acd58-1de2-48ed-a0a9-5b22513d5f72 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.420796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1012/2027] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:20 2022] PUT /identity/v3/projects/1dca922ee56646caa3c5c64e76be1c75/users/2bd72a7d59aa40588e58860196c5ea13/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:20.425721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08acd58-1de2-48ed-a0a9-5b22513d5f72 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.470797 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46eac9-3b2e-4924-b65e-dddb29a9bbbd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.533074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08acd58-1de2-48ed-a0a9-5b22513d5f72 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.540360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30030-9162-4ea8-aa0d-6cad776993da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.540973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30030-9162-4ea8-aa0d-6cad776993da admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.541342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30030-9162-4ea8-aa0d-6cad776993da admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.541779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30030-9162-4ea8-aa0d-6cad776993da admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.542443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30030-9162-4ea8-aa0d-6cad776993da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.544553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30030-9162-4ea8-aa0d-6cad776993da admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.560016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1013/2028] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:20.564221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30030-9162-4ea8-aa0d-6cad776993da admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.564689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ff158-ed6d-4de9-a5be-cd5a0cb35b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.565446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ff158-ed6d-4de9-a5be-cd5a0cb35b1f admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.565730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ff158-ed6d-4de9-a5be-cd5a0cb35b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.566164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ff158-ed6d-4de9-a5be-cd5a0cb35b1f admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.566865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ff158-ed6d-4de9-a5be-cd5a0cb35b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.568844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ff158-ed6d-4de9-a5be-cd5a0cb35b1f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.593155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30030-9162-4ea8-aa0d-6cad776993da admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.601967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1016/2029] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:20 2022] POST /identity/v3/users => generated 281 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:20.603372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ff158-ed6d-4de9-a5be-cd5a0cb35b1f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.603656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875e5af-5d94-424e-8555-ce1267231779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.604373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875e5af-5d94-424e-8555-ce1267231779 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.604983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875e5af-5d94-424e-8555-ce1267231779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.605104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-528ff158-ed6d-4de9-a5be-cd5a0cb35b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:20.605271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875e5af-5d94-424e-8555-ce1267231779 admin admin] PATH_INFO: `/v3/projects/1dca922ee56646caa3c5c64e76be1c75/users/2bd72a7d59aa40588e58860196c5ea13/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.607440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875e5af-5d94-424e-8555-ce1267231779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dca922ee56646caa3c5c64e76be1c75, user_id=2bd72a7d59aa40588e58860196c5ea13, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.610793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875e5af-5d94-424e-8555-ce1267231779 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.619301 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ff158-ed6d-4de9-a5be-cd5a0cb35b1f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.623400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1014/2030] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:20 2022] PUT /identity/v3/projects/1dca922ee56646caa3c5c64e76be1c75/users/2bd72a7d59aa40588e58860196c5ea13/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:20.624948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875e5af-5d94-424e-8555-ce1267231779 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.630433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:20.718669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.719547 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.720347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.720347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] PATH_INFO: `/v3/projects/48c57797509a404aabeedfec9b3d25f6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.722811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c57797509a404aabeedfec9b3d25f6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.725574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.736334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875e5af-5d94-424e-8555-ce1267231779 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.743779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3053557-2386-4675-b3a0-967283790a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.744448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3053557-2386-4675-b3a0-967283790a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.744799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3053557-2386-4675-b3a0-967283790a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.745081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3053557-2386-4675-b3a0-967283790a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.745741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3053557-2386-4675-b3a0-967283790a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.747604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3053557-2386-4675-b3a0-967283790a43 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:20.768727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1015/2031] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:20.768727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b7ca9-58f4-4580-a5d1-2281d40a009b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.768727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b7ca9-58f4-4580-a5d1-2281d40a009b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.768727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b7ca9-58f4-4580-a5d1-2281d40a009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.796630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c57797509a404aabeedfec9b3d25f6', 'request_id': 'req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:20.803466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c57797509a404aabeedfec9b3d25f6', 'request_id': 'req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:20.806634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-683b7ca9-58f4-4580-a5d1-2281d40a009b None None] MFA Rules not processed for user `2bd72a7d59aa40588e58860196c5ea13`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:20.807757 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-683b7ca9-58f4-4580-a5d1-2281d40a009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:20.817591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c57797509a404aabeedfec9b3d25f6', 'request_id': 'req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:20.833820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] The token cache is being invalidate because project 48c57797509a404aabeedfec9b3d25f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:20.834345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:20.835095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:20.844518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1017/2032] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:20 2022] DELETE /identity/v3/projects/48c57797509a404aabeedfec9b3d25f6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:20.845523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.847622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:20.892150 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:20.932558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1016/2033] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:20.932558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b4a0-d87c-4656-9a3a-8777c90a0a35 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.932558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b4a0-d87c-4656-9a3a-8777c90a0a35 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.932558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b4a0-d87c-4656-9a3a-8777c90a0a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.956642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2549b4a0-d87c-4656-9a3a-8777c90a0a35 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:20.958930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2549b4a0-d87c-4656-9a3a-8777c90a0a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:20.969625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1017/2034] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:20.970774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549b4a0-d87c-4656-9a3a-8777c90a0a35 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:20.974300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51ff27-ec3c-4336-8d56-33273cc0cd7a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:20.977336 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2549b4a0-d87c-4656-9a3a-8777c90a0a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:20.982544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b84d8d-da37-442c-be10-d06b626fe3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:20.983742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b84d8d-da37-442c-be10-d06b626fe3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:20.983742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b84d8d-da37-442c-be10-d06b626fe3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:20.983742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b84d8d-da37-442c-be10-d06b626fe3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:20.984638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b84d8d-da37-442c-be10-d06b626fe3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:20.986169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b84d8d-da37-442c-be10-d06b626fe3a5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:21.000834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1018/2035] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:21.000834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063f8c-442f-49dc-b86a-11999fd0e477 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.000834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063f8c-442f-49dc-b86a-11999fd0e477 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.000834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063f8c-442f-49dc-b86a-11999fd0e477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.021610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d0063f8c-442f-49dc-b86a-11999fd0e477 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:21.023153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d0063f8c-442f-49dc-b86a-11999fd0e477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:21.037029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1019/2036] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:21.038176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0063f8c-442f-49dc-b86a-11999fd0e477 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:21.055053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0063f8c-442f-49dc-b86a-11999fd0e477 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:21.060192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16cdba-0eb3-412e-8070-44377112ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:21.060925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16cdba-0eb3-412e-8070-44377112ee76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.061208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16cdba-0eb3-412e-8070-44377112ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.061645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16cdba-0eb3-412e-8070-44377112ee76 admin admin] PATH_INFO: `/v3/projects/0cd947fce8fe4c96b923def93d908f76/users/cd49f87a5acd4d49a7045742372c61b7/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.077047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549b4a0-d87c-4656-9a3a-8777c90a0a35 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:21.086955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16cdba-0eb3-412e-8070-44377112ee76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd947fce8fe4c96b923def93d908f76, user_id=cd49f87a5acd4d49a7045742372c61b7, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:21.090489 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c6d57-dd39-4669-b65d-081835e45792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:21.091090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16cdba-0eb3-412e-8070-44377112ee76 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:21.091204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6d57-dd39-4669-b65d-081835e45792 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.091411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6d57-dd39-4669-b65d-081835e45792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.091686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6d57-dd39-4669-b65d-081835e45792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.111272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1020/2037] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:21 2022] PUT /identity/v3/projects/0cd947fce8fe4c96b923def93d908f76/users/cd49f87a5acd4d49a7045742372c61b7/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:21.113397 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16cdba-0eb3-412e-8070-44377112ee76 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:21.121483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c6d57-dd39-4669-b65d-081835e45792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:21.122527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c6d57-dd39-4669-b65d-081835e45792 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:21.138277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:21.146813 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1018/2038] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:20 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:21.148691 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13802bf0-8e1c-4460-ad75-b39c05857a76 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.149487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13802bf0-8e1c-4460-ad75-b39c05857a76 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.150559 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13802bf0-8e1c-4460-ad75-b39c05857a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.229782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-13802bf0-8e1c-4460-ad75-b39c05857a76 None None] MFA Rules not processed for user `cd49f87a5acd4d49a7045742372c61b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:21.232170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-13802bf0-8e1c-4460-ad75-b39c05857a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:21.245020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16cdba-0eb3-412e-8070-44377112ee76 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:21.258514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8ef23-8e36-47af-a897-aecb3a3ef0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:21.259158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ef23-8e36-47af-a897-aecb3a3ef0fd admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.259899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ef23-8e36-47af-a897-aecb3a3ef0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.260186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ef23-8e36-47af-a897-aecb3a3ef0fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.260874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8ef23-8e36-47af-a897-aecb3a3ef0fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:21.261184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8ef23-8e36-47af-a897-aecb3a3ef0fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:21.269137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8ef23-8e36-47af-a897-aecb3a3ef0fd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:21.308882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1021/2039] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:21.318347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8ef23-8e36-47af-a897-aecb3a3ef0fd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:21.344058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8ef23-8e36-47af-a897-aecb3a3ef0fd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:21.350449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c9050-1c63-46f6-8059-7c349aa3dc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:21.351265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c9050-1c63-46f6-8059-7c349aa3dc1a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.351659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c9050-1c63-46f6-8059-7c349aa3dc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.351945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c9050-1c63-46f6-8059-7c349aa3dc1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.352638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c9050-1c63-46f6-8059-7c349aa3dc1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:21.398285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c9050-1c63-46f6-8059-7c349aa3dc1a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:21.432121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1019/2040] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:21.522322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13802bf0-8e1c-4460-ad75-b39c05857a76 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:21.522457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1022/2041] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:21 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:21.552614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13802bf0-8e1c-4460-ad75-b39c05857a76 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:21.574243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c9050-1c63-46f6-8059-7c349aa3dc1a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:21.576347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d76c9050-1c63-46f6-8059-7c349aa3dc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:21.702120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e74d3a-f495-42c4-9fb0-5c0a2dbaf4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:21.703252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74d3a-f495-42c4-9fb0-5c0a2dbaf4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.703813 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74d3a-f495-42c4-9fb0-5c0a2dbaf4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.704242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74d3a-f495-42c4-9fb0-5c0a2dbaf4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.705031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e74d3a-f495-42c4-9fb0-5c0a2dbaf4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:21.707331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e74d3a-f495-42c4-9fb0-5c0a2dbaf4b4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:21.723592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:21.728318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c9050-1c63-46f6-8059-7c349aa3dc1a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:21.741023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c931aec-a648-41cb-86e3-606e76f31d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:21.745239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c931aec-a648-41cb-86e3-606e76f31d75 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.745727 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c931aec-a648-41cb-86e3-606e76f31d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.746158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c931aec-a648-41cb-86e3-606e76f31d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.758701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1020/2042] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:21 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:21.759926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e74d3a-f495-42c4-9fb0-5c0a2dbaf4b4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:21.779409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e74d3a-f495-42c4-9fb0-5c0a2dbaf4b4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:21.786137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3544f8-2def-487c-b400-f6fb0f11aa5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:21.786807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3544f8-2def-487c-b400-f6fb0f11aa5c service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.787096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3544f8-2def-487c-b400-f6fb0f11aa5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.787374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3544f8-2def-487c-b400-f6fb0f11aa5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.789605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1c3544f8-2def-487c-b400-f6fb0f11aa5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:21.843119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c931aec-a648-41cb-86e3-606e76f31d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:21.844615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c931aec-a648-41cb-86e3-606e76f31d75 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:21.857265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1023/2043] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:21.865286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c931aec-a648-41cb-86e3-606e76f31d75 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:21.875825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3544f8-2def-487c-b400-f6fb0f11aa5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:21.878097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3544f8-2def-487c-b400-f6fb0f11aa5c service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:21.888473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c931aec-a648-41cb-86e3-606e76f31d75 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:21.889294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1021/2044] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:21 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:21.890146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3544f8-2def-487c-b400-f6fb0f11aa5c service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:21.904856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3544f8-2def-487c-b400-f6fb0f11aa5c service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:21.911172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:21.912091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.912419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.912706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] PATH_INFO: `/v3/users/cd49f87a5acd4d49a7045742372c61b7` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.913815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dd3fa-fd9b-48ef-9ad9-91b6f5b9f15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:21.914039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd49f87a5acd4d49a7045742372c61b7)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:21.914448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dd3fa-fd9b-48ef-9ad9-91b6f5b9f15f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:21.914732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dd3fa-fd9b-48ef-9ad9-91b6f5b9f15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:21.915010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dd3fa-fd9b-48ef-9ad9-91b6f5b9f15f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:21.915666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dd3fa-fd9b-48ef-9ad9-91b6f5b9f15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:21.916287 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:21.917292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dd3fa-fd9b-48ef-9ad9-91b6f5b9f15f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:21.958221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1024/2045] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:21.959041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dd3fa-fd9b-48ef-9ad9-91b6f5b9f15f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:21.980729 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dd3fa-fd9b-48ef-9ad9-91b6f5b9f15f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:22.009368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b7728-5e9d-4a63-b20c-9a54812c79cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:22.010268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7728-5e9d-4a63-b20c-9a54812c79cf admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:22.010456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7728-5e9d-4a63-b20c-9a54812c79cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:22.010794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7728-5e9d-4a63-b20c-9a54812c79cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:22.011564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b7728-5e9d-4a63-b20c-9a54812c79cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:22.013327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b7728-5e9d-4a63-b20c-9a54812c79cf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:22.026090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd49f87a5acd4d49a7045742372c61b7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:22.026780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd49f87a5acd4d49a7045742372c61b7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:22.041391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd49f87a5acd4d49a7045742372c61b7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:22.052886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1025/2046] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:22.054959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b7728-5e9d-4a63-b20c-9a54812c79cf admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:22.056350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd49f87a5acd4d49a7045742372c61b7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:22.059819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fa0b7728-5e9d-4a63-b20c-9a54812c79cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:22.089211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a4a6a91f-3710-4d0f-b95e-64d8fe4cb793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd49f87a5acd4d49a7045742372c61b7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:22.091386 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b7728-5e9d-4a63-b20c-9a54812c79cf admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:22.104380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1022/2047] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:21 2022] DELETE /identity/v3/users/cd49f87a5acd4d49a7045742372c61b7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:22.106175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e844c-0d93-4bbb-94c0-a9cb50adc380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:22.107731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e844c-0d93-4bbb-94c0-a9cb50adc380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:22.108240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e844c-0d93-4bbb-94c0-a9cb50adc380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:22.108559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e844c-0d93-4bbb-94c0-a9cb50adc380 admin admin] PATH_INFO: `/v3/projects/d12811ff6282403ca86cfa946ab6f1c3/users/2172fb63ee5940aa90a7858694e36078/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:22.110975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa1131-26e4-4a3c-ac4e-12c564bace13 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:22.111267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa1131-26e4-4a3c-ac4e-12c564bace13 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:22.112131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa1131-26e4-4a3c-ac4e-12c564bace13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:22.121896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:22.132887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e844c-0d93-4bbb-94c0-a9cb50adc380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12811ff6282403ca86cfa946ab6f1c3, user_id=2172fb63ee5940aa90a7858694e36078, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:22.146259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7daa1131-26e4-4a3c-ac4e-12c564bace13 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:22.147982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7daa1131-26e4-4a3c-ac4e-12c564bace13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:22.154772 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e844c-0d93-4bbb-94c0-a9cb50adc380 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:22.180276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1026/2048] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:22 2022] PUT /identity/v3/projects/d12811ff6282403ca86cfa946ab6f1c3/users/2172fb63ee5940aa90a7858694e36078/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:22.191523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733aeec-961a-4974-95c3-8647b322b949 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:22.191821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733aeec-961a-4974-95c3-8647b322b949 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:22.192109 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733aeec-961a-4974-95c3-8647b322b949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:22.247523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8733aeec-961a-4974-95c3-8647b322b949 None None] MFA Rules not processed for user `2172fb63ee5940aa90a7858694e36078`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:22.248845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8733aeec-961a-4974-95c3-8647b322b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:22.261474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1023/2049] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:22.328051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa1131-26e4-4a3c-ac4e-12c564bace13 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:22.331278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7daa1131-26e4-4a3c-ac4e-12c564bace13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:22.344359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:22.391416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1027/2050] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:22.406017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733aeec-961a-4974-95c3-8647b322b949 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:22.408249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8733aeec-961a-4974-95c3-8647b322b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:22.450775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa1131-26e4-4a3c-ac4e-12c564bace13 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:22.516868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733aeec-961a-4974-95c3-8647b322b949 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:22.523925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcee3-ad44-4db2-86c0-369e5e58bef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:22.524708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcee3-ad44-4db2-86c0-369e5e58bef1 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:22.524977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcee3-ad44-4db2-86c0-369e5e58bef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:22.525466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcee3-ad44-4db2-86c0-369e5e58bef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:22.537200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbcee3-ad44-4db2-86c0-369e5e58bef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:22.538666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbcee3-ad44-4db2-86c0-369e5e58bef1 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:22.551984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bca45b-96df-4022-b559-375f652d861e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:22.552746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bca45b-96df-4022-b559-375f652d861e service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:22.553090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bca45b-96df-4022-b559-375f652d861e service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:22.553720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bca45b-96df-4022-b559-375f652d861e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:22.554963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1028/2051] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:09:22.615388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcee3-ad44-4db2-86c0-369e5e58bef1 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:22.745741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcee3-ad44-4db2-86c0-369e5e58bef1 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:22.753622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:22.754286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:22.754570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:22.754848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] PATH_INFO: `/v3/users/2172fb63ee5940aa90a7858694e36078` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:22.756064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2172fb63ee5940aa90a7858694e36078)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:22.761042 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:22.766447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bca45b-96df-4022-b559-375f652d861e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:22.767404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bca45b-96df-4022-b559-375f652d861e service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:22.781424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1024/2052] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:09:22.822487 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:22.874996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2172fb63ee5940aa90a7858694e36078'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:22.876671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2172fb63ee5940aa90a7858694e36078'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:22.900878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2172fb63ee5940aa90a7858694e36078'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:22.948181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2172fb63ee5940aa90a7858694e36078'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:22.958438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2172fb63ee5940aa90a7858694e36078'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:22.965664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1029/2053] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:22 2022] DELETE /identity/v3/users/2172fb63ee5940aa90a7858694e36078 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:22.969835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0df61-3ac4-4d65-9c43-a212d12ff8dd None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:22.970314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0df61-3ac4-4d65-9c43-a212d12ff8dd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:22.970622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0df61-3ac4-4d65-9c43-a212d12ff8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:23.000381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-19f0df61-3ac4-4d65-9c43-a212d12ff8dd None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:23.001859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-19f0df61-3ac4-4d65-9c43-a212d12ff8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:23.134974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1025/2054] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:23.190516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:23.192289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:23.286757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cabb5-04a9-4ec3-a206-306afbfe8d60 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:23.291159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb839204-fc32-47cf-a075-35d5a5576dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:23.291882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb839204-fc32-47cf-a075-35d5a5576dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:23.292231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb839204-fc32-47cf-a075-35d5a5576dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:23.292684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb839204-fc32-47cf-a075-35d5a5576dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:23.327334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb839204-fc32-47cf-a075-35d5a5576dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:23.328914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb839204-fc32-47cf-a075-35d5a5576dcf service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:23.340786 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1030/2055] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:23.484241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0df61-3ac4-4d65-9c43-a212d12ff8dd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:23.485954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-19f0df61-3ac4-4d65-9c43-a212d12ff8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:23.507084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0df61-3ac4-4d65-9c43-a212d12ff8dd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:23.528968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:23.529805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:23.532199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:23.532720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] PATH_INFO: `/v3/users/5117e079ddfb46de857bb997be7145b3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:23.535199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5117e079ddfb46de857bb997be7145b3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:23.538817 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:23.545047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:23.608515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5117e079ddfb46de857bb997be7145b3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:23.614117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5117e079ddfb46de857bb997be7145b3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:23.630485 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5117e079ddfb46de857bb997be7145b3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:23.640520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5117e079ddfb46de857bb997be7145b3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:23.659547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5117e079ddfb46de857bb997be7145b3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:23.668091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1026/2056] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:23 2022] DELETE /identity/v3/users/5117e079ddfb46de857bb997be7145b3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:23.672638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71a3d2-af87-4ff9-b117-40c7964bb189 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:23.673063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71a3d2-af87-4ff9-b117-40c7964bb189 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:23.673439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71a3d2-af87-4ff9-b117-40c7964bb189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:23.715220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7c71a3d2-af87-4ff9-b117-40c7964bb189 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:23.718510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7c71a3d2-af87-4ff9-b117-40c7964bb189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:23.828450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1031/2057] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:23.879343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:23.880917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:23.977227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f67961-79b1-4fea-8972-575378c063d6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:23.984898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77af2c-74ef-4701-9183-a1380388be26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:23.986138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77af2c-74ef-4701-9183-a1380388be26 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:23.988655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77af2c-74ef-4701-9183-a1380388be26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:23.989340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77af2c-74ef-4701-9183-a1380388be26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:24.008299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77af2c-74ef-4701-9183-a1380388be26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:24.010719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77af2c-74ef-4701-9183-a1380388be26 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:24.032947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1027/2058] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:24.116615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71a3d2-af87-4ff9-b117-40c7964bb189 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:24.121987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7c71a3d2-af87-4ff9-b117-40c7964bb189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:24.158172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77af2c-74ef-4701-9183-a1380388be26 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:24.162850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7a77af2c-74ef-4701-9183-a1380388be26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:24.163016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71a3d2-af87-4ff9-b117-40c7964bb189 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:24.171160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:24.171950 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:24.172360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:24.173626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] PATH_INFO: `/v3/projects/0cd947fce8fe4c96b923def93d908f76` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:24.175856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd947fce8fe4c96b923def93d908f76)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:24.178451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:24.201331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77af2c-74ef-4701-9183-a1380388be26 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:24.223800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:24.225259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:24.227073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:24.227361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] PATH_INFO: `/v3/projects/d12811ff6282403ca86cfa946ab6f1c3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:24.230838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12811ff6282403ca86cfa946ab6f1c3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:24.236343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:24.257479 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:24.281833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd947fce8fe4c96b923def93d908f76', 'request_id': 'req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.297265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd947fce8fe4c96b923def93d908f76', 'request_id': 'req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.319967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd947fce8fe4c96b923def93d908f76', 'request_id': 'req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.340217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] The token cache is being invalidate because project 0cd947fce8fe4c96b923def93d908f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:24.340768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.351145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-696d3aee-6bfc-42bc-b791-0fa78ad3f04f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.356537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1032/2059] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:24 2022] DELETE /identity/v3/projects/0cd947fce8fe4c96b923def93d908f76 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:24.374420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4368b-b257-4575-a7fd-8949429bea04 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:24.374714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4368b-b257-4575-a7fd-8949429bea04 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:24.378282 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4368b-b257-4575-a7fd-8949429bea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:24.396500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12811ff6282403ca86cfa946ab6f1c3', 'request_id': 'req-1a42122e-663e-46d3-9601-43d27e8cd3e5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.402598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12811ff6282403ca86cfa946ab6f1c3', 'request_id': 'req-1a42122e-663e-46d3-9601-43d27e8cd3e5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.409756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12811ff6282403ca86cfa946ab6f1c3', 'request_id': 'req-1a42122e-663e-46d3-9601-43d27e8cd3e5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.413448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-74a4368b-b257-4575-a7fd-8949429bea04 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:24.415243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-74a4368b-b257-4575-a7fd-8949429bea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:24.425830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] The token cache is being invalidate because project d12811ff6282403ca86cfa946ab6f1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:24.426510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.427990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a42122e-663e-46d3-9601-43d27e8cd3e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.453406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1028/2060] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:24 2022] DELETE /identity/v3/projects/d12811ff6282403ca86cfa946ab6f1c3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:24.541234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1033/2061] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:24.544719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ad8e3-ad6a-4ede-9c3b-ae69d27c696b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:24.545216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ad8e3-ad6a-4ede-9c3b-ae69d27c696b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:24.546253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ad8e3-ad6a-4ede-9c3b-ae69d27c696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:24.589743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9a4ad8e3-ad6a-4ede-9c3b-ae69d27c696b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:24.591386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9a4ad8e3-ad6a-4ede-9c3b-ae69d27c696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:24.630050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1029/2062] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:24.632707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4368b-b257-4575-a7fd-8949429bea04 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:24.654404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4368b-b257-4575-a7fd-8949429bea04 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:24.665483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced63e5a-43be-475b-af02-0fb8359a7337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:24.666603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63e5a-43be-475b-af02-0fb8359a7337 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:24.666888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63e5a-43be-475b-af02-0fb8359a7337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:24.667165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63e5a-43be-475b-af02-0fb8359a7337 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:24.667823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced63e5a-43be-475b-af02-0fb8359a7337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:24.668130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced63e5a-43be-475b-af02-0fb8359a7337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:24.670831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced63e5a-43be-475b-af02-0fb8359a7337 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:24.694837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1034/2063] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:24.695600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ad8e3-ad6a-4ede-9c3b-ae69d27c696b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:24.700631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:24.707654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ad8e3-ad6a-4ede-9c3b-ae69d27c696b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:24.714670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cb15a-41e3-42c8-bdc1-f35496b41d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:24.715416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cb15a-41e3-42c8-bdc1-f35496b41d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:24.716573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cb15a-41e3-42c8-bdc1-f35496b41d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:24.717031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cb15a-41e3-42c8-bdc1-f35496b41d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:24.717819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cb15a-41e3-42c8-bdc1-f35496b41d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:24.719920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cb15a-41e3-42c8-bdc1-f35496b41d52 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:24.747355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced63e5a-43be-475b-af02-0fb8359a7337 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:24.749585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ced63e5a-43be-475b-af02-0fb8359a7337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:24.754339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1030/2064] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:24 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:24.758661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cb15a-41e3-42c8-bdc1-f35496b41d52 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:24.770664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced63e5a-43be-475b-af02-0fb8359a7337 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:24.829839 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cb15a-41e3-42c8-bdc1-f35496b41d52 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:24.835807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61468919-2c0c-4231-a3b4-ad2b4097164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:24.836457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61468919-2c0c-4231-a3b4-ad2b4097164e admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:24.836738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61468919-2c0c-4231-a3b4-ad2b4097164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:24.837014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61468919-2c0c-4231-a3b4-ad2b4097164e admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:24.837644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61468919-2c0c-4231-a3b4-ad2b4097164e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:24.839554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61468919-2c0c-4231-a3b4-ad2b4097164e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:24.841503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:24.842869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:24.843304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:24.843731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] PATH_INFO: `/v3/projects/50f3905453a5474ca07b25041549fe75` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:24.845050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f3905453a5474ca07b25041549fe75)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:24.848350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:24.864750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1031/2065] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:24 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:24.868880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61468919-2c0c-4231-a3b4-ad2b4097164e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:24.881715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61468919-2c0c-4231-a3b4-ad2b4097164e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:24.886994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644318a2-fa18-43d5-97c8-4f47be4643a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:24.887669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644318a2-fa18-43d5-97c8-4f47be4643a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:24.888180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644318a2-fa18-43d5-97c8-4f47be4643a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:24.888502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644318a2-fa18-43d5-97c8-4f47be4643a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:24.889158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644318a2-fa18-43d5-97c8-4f47be4643a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:24.890764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644318a2-fa18-43d5-97c8-4f47be4643a7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:24.910187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1032/2066] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:24.914519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644318a2-fa18-43d5-97c8-4f47be4643a7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:24.920056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f3905453a5474ca07b25041549fe75', 'request_id': 'req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.925559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:24.930463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f3905453a5474ca07b25041549fe75', 'request_id': 'req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.933390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644318a2-fa18-43d5-97c8-4f47be4643a7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:24.944018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f3905453a5474ca07b25041549fe75', 'request_id': 'req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.965768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] The token cache is being invalidate because project 50f3905453a5474ca07b25041549fe75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:24.966364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.967280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:24.969264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1035/2067] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:24 2022] DELETE /identity/v3/projects/50f3905453a5474ca07b25041549fe75 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:24.973229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:24.974882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:25.021525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d807547-d4aa-4665-a287-3e60652926e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:25.022893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d807547-d4aa-4665-a287-3e60652926e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:25.023422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d807547-d4aa-4665-a287-3e60652926e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:25.023712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d807547-d4aa-4665-a287-3e60652926e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:25.024410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d807547-d4aa-4665-a287-3e60652926e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:25.026083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d807547-d4aa-4665-a287-3e60652926e7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:25.053067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1033/2068] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:25.053939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d807547-d4aa-4665-a287-3e60652926e7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:25.055677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2d807547-d4aa-4665-a287-3e60652926e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:25.060763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391f75a-c3b2-4b0f-96dd-09f88f9e7c33 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:25.066359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:25.067106 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:25.067390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:25.067660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] PATH_INFO: `/v3/users/1b647ec47ef94167908f9557540a1cce` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:25.069031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b647ec47ef94167908f9557540a1cce)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:25.070026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d807547-d4aa-4665-a287-3e60652926e7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:25.070747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:25.075314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5f5f5-26a1-4086-9801-3df746157079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:25.076061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5f5f5-26a1-4086-9801-3df746157079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:25.076378 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5f5f5-26a1-4086-9801-3df746157079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:25.076677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5f5f5-26a1-4086-9801-3df746157079 admin admin] PATH_INFO: `/v3/projects/7f4082aea09f4b76a7d4e4b771e65eef/users/52760df64f064e0491551d0fc4025388/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:25.094905 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5f5f5-26a1-4086-9801-3df746157079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4082aea09f4b76a7d4e4b771e65eef, user_id=52760df64f064e0491551d0fc4025388, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:25.100058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5f5f5-26a1-4086-9801-3df746157079 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:25.115910 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1034/2069] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:25 2022] PUT /identity/v3/projects/7f4082aea09f4b76a7d4e4b771e65eef/users/52760df64f064e0491551d0fc4025388/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:25.129237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad0a66-da0c-458e-8514-062c1aaa8af4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:25.131028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad0a66-da0c-458e-8514-062c1aaa8af4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:25.131533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad0a66-da0c-458e-8514-062c1aaa8af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:25.131696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b647ec47ef94167908f9557540a1cce'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:25.132494 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b647ec47ef94167908f9557540a1cce'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:25.140845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b647ec47ef94167908f9557540a1cce'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:25.159508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b647ec47ef94167908f9557540a1cce'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:25.166898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7aad0a66-da0c-458e-8514-062c1aaa8af4 None None] MFA Rules not processed for user `52760df64f064e0491551d0fc4025388`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:25.167889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b647ec47ef94167908f9557540a1cce'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:25.168113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7aad0a66-da0c-458e-8514-062c1aaa8af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:25.176223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1036/2070] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:24 2022] DELETE /identity/v3/users/1b647ec47ef94167908f9557540a1cce => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:25.193006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:25.253317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1035/2071] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:25.265745 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:25.267239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:25.343294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb030d23-08df-443c-9694-de9ab6ad64ee admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:25.352627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bcfb3-f2ae-464f-9531-a3e75f067f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:25.353358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bcfb3-f2ae-464f-9531-a3e75f067f99 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:25.354174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bcfb3-f2ae-464f-9531-a3e75f067f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:25.354174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bcfb3-f2ae-464f-9531-a3e75f067f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:25.371339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:25.421715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bcfb3-f2ae-464f-9531-a3e75f067f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:25.423150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bcfb3-f2ae-464f-9531-a3e75f067f99 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:25.432541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1037/2072] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:25.490556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad0a66-da0c-458e-8514-062c1aaa8af4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:25.492187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7aad0a66-da0c-458e-8514-062c1aaa8af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:25.579088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad0a66-da0c-458e-8514-062c1aaa8af4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:25.653358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:25.654046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:25.654449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:25.654808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] PATH_INFO: `/v3/projects/77a90d75169a47c381cd6323e9d2a420` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:25.656186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a90d75169a47c381cd6323e9d2a420)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:25.658350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:25.717166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a90d75169a47c381cd6323e9d2a420', 'request_id': 'req-bd37f234-347a-4626-960d-d851c5cfb33d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:25.723771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a90d75169a47c381cd6323e9d2a420', 'request_id': 'req-bd37f234-347a-4626-960d-d851c5cfb33d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:25.731647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a90d75169a47c381cd6323e9d2a420', 'request_id': 'req-bd37f234-347a-4626-960d-d851c5cfb33d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:25.743500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:25.755032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] The token cache is being invalidate because project 77a90d75169a47c381cd6323e9d2a420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:25.755319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:25.758743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bd37f234-347a-4626-960d-d851c5cfb33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:25.758743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1036/2073] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:25 2022] DELETE /identity/v3/projects/77a90d75169a47c381cd6323e9d2a420 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:25.762969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8c3c-e445-4e4d-9090-6beb55ed2dc0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:25.763751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8c3c-e445-4e4d-9090-6beb55ed2dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:25.764241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8c3c-e445-4e4d-9090-6beb55ed2dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:25.793361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-eb4f8c3c-e445-4e4d-9090-6beb55ed2dc0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:25.794944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eb4f8c3c-e445-4e4d-9090-6beb55ed2dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:25.881667 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1038/2074] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:25.889424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e757952-47ba-4486-a0a3-d340b2250ebf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:25.889820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e757952-47ba-4486-a0a3-d340b2250ebf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:25.890106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e757952-47ba-4486-a0a3-d340b2250ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:25.913459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4e757952-47ba-4486-a0a3-d340b2250ebf None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:25.914257 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4e757952-47ba-4486-a0a3-d340b2250ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:25.922416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1037/2075] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:25.926869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f8c3c-e445-4e4d-9090-6beb55ed2dc0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:25.936826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f8c3c-e445-4e4d-9090-6beb55ed2dc0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:25.941492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af9b6c-c9af-48cf-be29-0917f988f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:25.942097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9b6c-c9af-48cf-be29-0917f988f4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:25.942380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9b6c-c9af-48cf-be29-0917f988f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:25.942658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9b6c-c9af-48cf-be29-0917f988f4a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:25.943303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af9b6c-c9af-48cf-be29-0917f988f4a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:25.943614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af9b6c-c9af-48cf-be29-0917f988f4a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:25.945289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af9b6c-c9af-48cf-be29-0917f988f4a0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:25.958071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1039/2076] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:25.962343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e757952-47ba-4486-a0a3-d340b2250ebf None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:25.972210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e757952-47ba-4486-a0a3-d340b2250ebf None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:25.976934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728135ad-c821-470d-94eb-17101aaa519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:25.977534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728135ad-c821-470d-94eb-17101aaa519a admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:25.977821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728135ad-c821-470d-94eb-17101aaa519a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:25.978097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728135ad-c821-470d-94eb-17101aaa519a admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:25.978745 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728135ad-c821-470d-94eb-17101aaa519a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:25.980685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728135ad-c821-470d-94eb-17101aaa519a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.008528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1038/2077] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:25 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:26.012746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af9b6c-c9af-48cf-be29-0917f988f4a0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:26.023923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af9b6c-c9af-48cf-be29-0917f988f4a0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:26.087904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a0f64-8fd6-4495-a454-b89c087bf3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:26.088559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a0f64-8fd6-4495-a454-b89c087bf3bd admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.088846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a0f64-8fd6-4495-a454-b89c087bf3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.089122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a0f64-8fd6-4495-a454-b89c087bf3bd admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.089765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a0f64-8fd6-4495-a454-b89c087bf3bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:26.091719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a0f64-8fd6-4495-a454-b89c087bf3bd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.119092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1040/2078] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:26 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:26.120317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728135ad-c821-470d-94eb-17101aaa519a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:26.139831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728135ad-c821-470d-94eb-17101aaa519a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:26.145912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48996dc8-dbcc-4de8-b362-27264349e249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:26.146644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48996dc8-dbcc-4de8-b362-27264349e249 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.146974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48996dc8-dbcc-4de8-b362-27264349e249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.147319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48996dc8-dbcc-4de8-b362-27264349e249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.148037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48996dc8-dbcc-4de8-b362-27264349e249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:26.149758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48996dc8-dbcc-4de8-b362-27264349e249 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.161641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1039/2079] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:26.165738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a0f64-8fd6-4495-a454-b89c087bf3bd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:26.177293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a0f64-8fd6-4495-a454-b89c087bf3bd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:26.182129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f5dcc-31b0-4b5e-82a3-76747d4e9495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:26.182815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f5dcc-31b0-4b5e-82a3-76747d4e9495 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.184375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f5dcc-31b0-4b5e-82a3-76747d4e9495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.184375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f5dcc-31b0-4b5e-82a3-76747d4e9495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.184375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f5dcc-31b0-4b5e-82a3-76747d4e9495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:26.186053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f5dcc-31b0-4b5e-82a3-76747d4e9495 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.199225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1041/2080] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:26.203351 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48996dc8-dbcc-4de8-b362-27264349e249 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:26.215084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48996dc8-dbcc-4de8-b362-27264349e249 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:26.220622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb1428-5615-4ed2-bab6-2f70f512fce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:26.221851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb1428-5615-4ed2-bab6-2f70f512fce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.222130 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb1428-5615-4ed2-bab6-2f70f512fce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.222406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb1428-5615-4ed2-bab6-2f70f512fce0 admin admin] PATH_INFO: `/v3/projects/79434bac99d54a099f7584f4cd998725/users/2787c9846d39468aa27f3903a4151742/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.238575 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb1428-5615-4ed2-bab6-2f70f512fce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79434bac99d54a099f7584f4cd998725, user_id=2787c9846d39468aa27f3903a4151742, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:26.241261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb1428-5615-4ed2-bab6-2f70f512fce0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.256835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1040/2081] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:26 2022] PUT /identity/v3/projects/79434bac99d54a099f7584f4cd998725/users/2787c9846d39468aa27f3903a4151742/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:26.268000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96fd0-3487-4164-ac6b-2b97a67ca572 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.268545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96fd0-3487-4164-ac6b-2b97a67ca572 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.268545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96fd0-3487-4164-ac6b-2b97a67ca572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.305121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-72e96fd0-3487-4164-ac6b-2b97a67ca572 None None] MFA Rules not processed for user `2787c9846d39468aa27f3903a4151742`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:26.306349 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-72e96fd0-3487-4164-ac6b-2b97a67ca572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:26.316934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:26.397315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1042/2082] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:26.398784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb1428-5615-4ed2-bab6-2f70f512fce0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:26.481805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb1428-5615-4ed2-bab6-2f70f512fce0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:26.493137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeae8da-854b-4687-8d54-419ad82c7b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:26.493890 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae8da-854b-4687-8d54-419ad82c7b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.494186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae8da-854b-4687-8d54-419ad82c7b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.496190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae8da-854b-4687-8d54-419ad82c7b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.497107 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeae8da-854b-4687-8d54-419ad82c7b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:26.505475 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeae8da-854b-4687-8d54-419ad82c7b23 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.543313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1041/2083] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:26 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:26.544753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96fd0-3487-4164-ac6b-2b97a67ca572 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:26.556946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96fd0-3487-4164-ac6b-2b97a67ca572 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:26.623330 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d3dbe-e808-4176-bc17-f544d372c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:26.624079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d3dbe-e808-4176-bc17-f544d372c965 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.624623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d3dbe-e808-4176-bc17-f544d372c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.624623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d3dbe-e808-4176-bc17-f544d372c965 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.625126 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d3dbe-e808-4176-bc17-f544d372c965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:26.627098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d3dbe-e808-4176-bc17-f544d372c965 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.651464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1043/2084] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:26 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:26.655653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeae8da-854b-4687-8d54-419ad82c7b23 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:26.668214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeae8da-854b-4687-8d54-419ad82c7b23 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:26.674271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41140a4d-c958-4eae-b0f8-dd4246159bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:26.675408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41140a4d-c958-4eae-b0f8-dd4246159bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.675408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41140a4d-c958-4eae-b0f8-dd4246159bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.675585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41140a4d-c958-4eae-b0f8-dd4246159bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.676774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41140a4d-c958-4eae-b0f8-dd4246159bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:26.678463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41140a4d-c958-4eae-b0f8-dd4246159bcf admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.689989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1042/2085] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:26.694376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d3dbe-e808-4176-bc17-f544d372c965 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:26.704631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d3dbe-e808-4176-bc17-f544d372c965 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:26.710932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be811f-3dce-4bd1-94c4-7529ae049292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:26.711638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be811f-3dce-4bd1-94c4-7529ae049292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.711887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be811f-3dce-4bd1-94c4-7529ae049292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.712160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be811f-3dce-4bd1-94c4-7529ae049292 admin admin] PATH_INFO: `/v3/projects/c0add8fd7df147e1ba09cb9b72a41e1b/users/bbdc78556ce14f188c3788498d0e8df2/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.729071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be811f-3dce-4bd1-94c4-7529ae049292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0add8fd7df147e1ba09cb9b72a41e1b, user_id=bbdc78556ce14f188c3788498d0e8df2, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:26.731706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be811f-3dce-4bd1-94c4-7529ae049292 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.745025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1044/2086] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:26 2022] PUT /identity/v3/projects/c0add8fd7df147e1ba09cb9b72a41e1b/users/bbdc78556ce14f188c3788498d0e8df2/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:26.749129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41140a4d-c958-4eae-b0f8-dd4246159bcf admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:26.759462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41140a4d-c958-4eae-b0f8-dd4246159bcf admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:26.819623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4ee9c-1bad-4015-a58f-ea87afb6327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:26.820236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ee9c-1bad-4015-a58f-ea87afb6327c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.820552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ee9c-1bad-4015-a58f-ea87afb6327c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.820829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ee9c-1bad-4015-a58f-ea87afb6327c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.821475 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4ee9c-1bad-4015-a58f-ea87afb6327c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:26.823067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4ee9c-1bad-4015-a58f-ea87afb6327c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.834751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1043/2087] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:26.838726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be811f-3dce-4bd1-94c4-7529ae049292 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:26.849902 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be811f-3dce-4bd1-94c4-7529ae049292 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:26.856517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23890f92-2fa8-4601-b0b2-4b964af6d44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:26.857215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23890f92-2fa8-4601-b0b2-4b964af6d44a admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.857497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23890f92-2fa8-4601-b0b2-4b964af6d44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.857773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23890f92-2fa8-4601-b0b2-4b964af6d44a admin admin] PATH_INFO: `/v3/projects/c0add8fd7df147e1ba09cb9b72a41e1b/users/bbdc78556ce14f188c3788498d0e8df2/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.860597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23890f92-2fa8-4601-b0b2-4b964af6d44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0add8fd7df147e1ba09cb9b72a41e1b, user_id=bbdc78556ce14f188c3788498d0e8df2, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:26.866146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23890f92-2fa8-4601-b0b2-4b964af6d44a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:26.880451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1045/2088] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:26 2022] PUT /identity/v3/projects/c0add8fd7df147e1ba09cb9b72a41e1b/users/bbdc78556ce14f188c3788498d0e8df2/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:26.889387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c2e7f-f6b2-4b64-b4d6-ac53b834ef2e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:26.889684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c2e7f-f6b2-4b64-b4d6-ac53b834ef2e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:26.889994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c2e7f-f6b2-4b64-b4d6-ac53b834ef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:26.898802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:26.936529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5a1c2e7f-f6b2-4b64-b4d6-ac53b834ef2e None None] MFA Rules not processed for user `bbdc78556ce14f188c3788498d0e8df2`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:26.937616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5a1c2e7f-f6b2-4b64-b4d6-ac53b834ef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:27.030919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1044/2089] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:27.045594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23890f92-2fa8-4601-b0b2-4b964af6d44a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:27.047565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-23890f92-2fa8-4601-b0b2-4b964af6d44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:27.145103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23890f92-2fa8-4601-b0b2-4b964af6d44a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:27.149148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039d3d0-67ab-4426-b3d4-19369c2f9fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:27.149761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039d3d0-67ab-4426-b3d4-19369c2f9fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:27.150339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039d3d0-67ab-4426-b3d4-19369c2f9fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:27.150339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039d3d0-67ab-4426-b3d4-19369c2f9fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:27.160816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039d3d0-67ab-4426-b3d4-19369c2f9fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:27.162320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039d3d0-67ab-4426-b3d4-19369c2f9fe7 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:27.172238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1046/2090] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:27.243339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c2e7f-f6b2-4b64-b4d6-ac53b834ef2e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:27.311577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c2e7f-f6b2-4b64-b4d6-ac53b834ef2e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:27.316535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:27.317171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:27.317480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:27.317728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] PATH_INFO: `/v3/users/2787c9846d39468aa27f3903a4151742` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:27.319053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2787c9846d39468aa27f3903a4151742)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:27.321187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:27.379599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2787c9846d39468aa27f3903a4151742'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:27.380268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2787c9846d39468aa27f3903a4151742'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:27.398343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2787c9846d39468aa27f3903a4151742'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:27.408122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2787c9846d39468aa27f3903a4151742'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:27.420909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2787c9846d39468aa27f3903a4151742'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:27.427098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1045/2091] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:27 2022] DELETE /identity/v3/users/2787c9846d39468aa27f3903a4151742 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:27.431741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd834162-9651-4006-a7ce-4931dad7696e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:27.432505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd834162-9651-4006-a7ce-4931dad7696e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:27.432505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd834162-9651-4006-a7ce-4931dad7696e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:27.446325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:27.453954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cd834162-9651-4006-a7ce-4931dad7696e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:27.456798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cd834162-9651-4006-a7ce-4931dad7696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:27.532473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1047/2092] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:27.542792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:27.544261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:27.555390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:27.608400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb4b90-694d-4430-93b9-91fe11310fb3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:27.613407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0c8ea-6c60-4bc8-b622-9b3080101c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:27.614158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c8ea-6c60-4bc8-b622-9b3080101c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:27.614471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c8ea-6c60-4bc8-b622-9b3080101c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:27.614787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c8ea-6c60-4bc8-b622-9b3080101c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:27.625780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0c8ea-6c60-4bc8-b622-9b3080101c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:27.627414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0c8ea-6c60-4bc8-b622-9b3080101c14 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:27.637625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1046/2093] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:27.701165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd834162-9651-4006-a7ce-4931dad7696e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:27.702767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cd834162-9651-4006-a7ce-4931dad7696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:27.716449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd834162-9651-4006-a7ce-4931dad7696e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:27.721689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:27.722465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:27.722754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:27.723036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] PATH_INFO: `/v3/users/9080ee05860946189836eaf7910f0048` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:27.724365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9080ee05860946189836eaf7910f0048)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:27.726340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:27.780526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9080ee05860946189836eaf7910f0048'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:27.781217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9080ee05860946189836eaf7910f0048'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:27.790088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9080ee05860946189836eaf7910f0048'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:27.804425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9080ee05860946189836eaf7910f0048'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:27.812031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9080ee05860946189836eaf7910f0048'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:27.819138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1048/2094] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:27 2022] DELETE /identity/v3/users/9080ee05860946189836eaf7910f0048 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:27.823963 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69141eab-24b5-4c8a-a349-a4d4f5bbf903 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:27.824314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69141eab-24b5-4c8a-a349-a4d4f5bbf903 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:27.824637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69141eab-24b5-4c8a-a349-a4d4f5bbf903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:27.845328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-69141eab-24b5-4c8a-a349-a4d4f5bbf903 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:27.846776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-69141eab-24b5-4c8a-a349-a4d4f5bbf903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:27.916389 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1047/2095] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:27.928808 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:27.930792 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:27.997367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c383a40-6775-4ed2-a2bf-bd245eb80382 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:28.001590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98911b21-36e1-4b85-a4a5-2feadfa1c835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:28.003030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98911b21-36e1-4b85-a4a5-2feadfa1c835 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:28.003515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98911b21-36e1-4b85-a4a5-2feadfa1c835 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:28.003892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98911b21-36e1-4b85-a4a5-2feadfa1c835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:28.015114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98911b21-36e1-4b85-a4a5-2feadfa1c835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:28.016866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98911b21-36e1-4b85-a4a5-2feadfa1c835 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:28.028391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1049/2096] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:28.199466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69141eab-24b5-4c8a-a349-a4d4f5bbf903 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:28.201153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98911b21-36e1-4b85-a4a5-2feadfa1c835 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:28.201309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-69141eab-24b5-4c8a-a349-a4d4f5bbf903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:28.202849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-98911b21-36e1-4b85-a4a5-2feadfa1c835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:28.218081 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98911b21-36e1-4b85-a4a5-2feadfa1c835 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:28.219076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69141eab-24b5-4c8a-a349-a4d4f5bbf903 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:28.225522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:28.226497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:28.226846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:28.227187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:28.227575 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:28.227850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] PATH_INFO: `/v3/users/52760df64f064e0491551d0fc4025388` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:28.228016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:28.228354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] PATH_INFO: `/v3/projects/79434bac99d54a099f7584f4cd998725` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:28.229702 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52760df64f064e0491551d0fc4025388)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:28.230558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] RBAC: Authorizing `identity:delete_project(project_id=79434bac99d54a099f7584f4cd998725)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:28.233212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:28.238251 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:28.257196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:28.296910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52760df64f064e0491551d0fc4025388'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.298202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52760df64f064e0491551d0fc4025388'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.308127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52760df64f064e0491551d0fc4025388'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.311067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79434bac99d54a099f7584f4cd998725', 'request_id': 'req-2c19f35c-e4b3-4f60-84b8-9828ff97003c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.318423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79434bac99d54a099f7584f4cd998725', 'request_id': 'req-2c19f35c-e4b3-4f60-84b8-9828ff97003c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.323737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52760df64f064e0491551d0fc4025388'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.328498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79434bac99d54a099f7584f4cd998725', 'request_id': 'req-2c19f35c-e4b3-4f60-84b8-9828ff97003c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.339038 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-288e614b-7b42-4425-bee6-25b4c9492500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52760df64f064e0491551d0fc4025388'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.350498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1050/2097] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:28 2022] DELETE /identity/v3/users/52760df64f064e0491551d0fc4025388 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:28.350649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] The token cache is being invalidate because project 79434bac99d54a099f7584f4cd998725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:28.350649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.350802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.352500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1048/2098] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:28 2022] DELETE /identity/v3/projects/79434bac99d54a099f7584f4cd998725 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:28.353761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29563e48-2be4-48a9-b86c-2f8e3f0afe8c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:28.354250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29563e48-2be4-48a9-b86c-2f8e3f0afe8c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:28.354653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29563e48-2be4-48a9-b86c-2f8e3f0afe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:28.356887 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:28.358863 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:28.381379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-29563e48-2be4-48a9-b86c-2f8e3f0afe8c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:28.383008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-29563e48-2be4-48a9-b86c-2f8e3f0afe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:28.415069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:28.446481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19f35c-e4b3-4f60-84b8-9828ff97003c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:28.467895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1051/2099] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:28.475936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29563e48-2be4-48a9-b86c-2f8e3f0afe8c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:28.477910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-29563e48-2be4-48a9-b86c-2f8e3f0afe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:28.526643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:28.528088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:28.528694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:28.529289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] PATH_INFO: `/v3/users/bbdc78556ce14f188c3788498d0e8df2` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:28.530919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbdc78556ce14f188c3788498d0e8df2)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:28.535493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:28.566244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29563e48-2be4-48a9-b86c-2f8e3f0afe8c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:28.574363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22109fa3-ecb8-483f-a9eb-afda4302e48c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:28.575359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109fa3-ecb8-483f-a9eb-afda4302e48c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:28.575821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109fa3-ecb8-483f-a9eb-afda4302e48c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:28.576505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109fa3-ecb8-483f-a9eb-afda4302e48c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:28.592128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22109fa3-ecb8-483f-a9eb-afda4302e48c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:28.594170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22109fa3-ecb8-483f-a9eb-afda4302e48c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:28.609323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1052/2100] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:09:28.632289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22109fa3-ecb8-483f-a9eb-afda4302e48c service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:28.635344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-22109fa3-ecb8-483f-a9eb-afda4302e48c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:28.648585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbdc78556ce14f188c3788498d0e8df2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.650029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbdc78556ce14f188c3788498d0e8df2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.666330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbdc78556ce14f188c3788498d0e8df2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.668917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22109fa3-ecb8-483f-a9eb-afda4302e48c service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:28.678120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbdc78556ce14f188c3788498d0e8df2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.685602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:28.686270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:28.686777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:28.686881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] PATH_INFO: `/v3/projects/b86f3468b8934957b159584f54ea85b3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:28.690969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86f3468b8934957b159584f54ea85b3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:28.693041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:28.695202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbdc78556ce14f188c3788498d0e8df2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.703645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1049/2101] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:28 2022] DELETE /identity/v3/users/bbdc78556ce14f188c3788498d0e8df2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:28.768807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:28.783872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86f3468b8934957b159584f54ea85b3', 'request_id': 'req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.792078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86f3468b8934957b159584f54ea85b3', 'request_id': 'req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.805945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86f3468b8934957b159584f54ea85b3', 'request_id': 'req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.826290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] The token cache is being invalidate because project b86f3468b8934957b159584f54ea85b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:28.826813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.829703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:28.838189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:28.839582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1053/2102] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:28 2022] DELETE /identity/v3/projects/b86f3468b8934957b159584f54ea85b3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:28.840408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:28.927921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69dee6-78ce-4bdb-89a3-3218cdc21c17 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:28.933241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:28.997914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:28.998235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:28.998532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:28.998806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] PATH_INFO: `/v3/users/2bd72a7d59aa40588e58860196c5ea13` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:29.001051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd72a7d59aa40588e58860196c5ea13)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:29.003741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:29.060715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd72a7d59aa40588e58860196c5ea13'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.061417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd72a7d59aa40588e58860196c5ea13'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.073995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd72a7d59aa40588e58860196c5ea13'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.082563 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd72a7d59aa40588e58860196c5ea13'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.097007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd72a7d59aa40588e58860196c5ea13'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.103379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1050/2103] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:28 2022] DELETE /identity/v3/users/2bd72a7d59aa40588e58860196c5ea13 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:29.695506 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:29.697517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:29.710763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36cc56-ca4d-41c8-9c17-b78fd6251e2d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:29.782650 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:29.783313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:29.783740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:29.784024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] PATH_INFO: `/v3/projects/7f4082aea09f4b76a7d4e4b771e65eef` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:29.785301 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4082aea09f4b76a7d4e4b771e65eef)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:29.787204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:29.792883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:29.794886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:29.811654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c35e1-fc25-4635-980b-8b6cafe89076 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:29.817977 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:29.818654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:29.818981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:29.819299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] PATH_INFO: `/v3/projects/c0add8fd7df147e1ba09cb9b72a41e1b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:29.820782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0add8fd7df147e1ba09cb9b72a41e1b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:29.823102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:29.847140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4082aea09f4b76a7d4e4b771e65eef', 'request_id': 'req-2d686226-7125-49e1-b03e-34c746d89e77'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.855602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4082aea09f4b76a7d4e4b771e65eef', 'request_id': 'req-2d686226-7125-49e1-b03e-34c746d89e77'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.865102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4082aea09f4b76a7d4e4b771e65eef', 'request_id': 'req-2d686226-7125-49e1-b03e-34c746d89e77'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.878346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] The token cache is being invalidate because project 7f4082aea09f4b76a7d4e4b771e65eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:29.878629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.879387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d686226-7125-49e1-b03e-34c746d89e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.884276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1054/2104] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:29 2022] DELETE /identity/v3/projects/7f4082aea09f4b76a7d4e4b771e65eef => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:29.884480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0add8fd7df147e1ba09cb9b72a41e1b', 'request_id': 'req-1a341839-e6c3-48f1-bf03-d496bd89be1b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.885890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef6f8c-6e64-406f-867e-a00e9bd97368 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:29.886171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef6f8c-6e64-406f-867e-a00e9bd97368 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:29.886445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef6f8c-6e64-406f-867e-a00e9bd97368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:29.895233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0add8fd7df147e1ba09cb9b72a41e1b', 'request_id': 'req-1a341839-e6c3-48f1-bf03-d496bd89be1b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.904205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0add8fd7df147e1ba09cb9b72a41e1b', 'request_id': 'req-1a341839-e6c3-48f1-bf03-d496bd89be1b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.907209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dbef6f8c-6e64-406f-867e-a00e9bd97368 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:29.909018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dbef6f8c-6e64-406f-867e-a00e9bd97368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:29.920492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] The token cache is being invalidate because project c0add8fd7df147e1ba09cb9b72a41e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:29.920952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.921629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a341839-e6c3-48f1-bf03-d496bd89be1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:29.923436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1051/2105] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:29 2022] DELETE /identity/v3/projects/c0add8fd7df147e1ba09cb9b72a41e1b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:29.928981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ce05-0541-4388-bc7f-dee702c86219 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:29.929277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ce05-0541-4388-bc7f-dee702c86219 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:29.929558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ce05-0541-4388-bc7f-dee702c86219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:29.953061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-96a0ce05-0541-4388-bc7f-dee702c86219 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:29.954520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-96a0ce05-0541-4388-bc7f-dee702c86219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:29.961163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:29.966117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:29.985852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1055/2106] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:29.993934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24894bc0-e1c2-4839-a3c7-4e869013f4ca None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:29.994368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24894bc0-e1c2-4839-a3c7-4e869013f4ca None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:29.995081 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24894bc0-e1c2-4839-a3c7-4e869013f4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.020992 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-24894bc0-e1c2-4839-a3c7-4e869013f4ca None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:30.022514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-24894bc0-e1c2-4839-a3c7-4e869013f4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:30.036267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1056/2107] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:30.038047 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24894bc0-e1c2-4839-a3c7-4e869013f4ca None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.050269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24894bc0-e1c2-4839-a3c7-4e869013f4ca None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.062943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1052/2108] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:30.074428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab05e67-ff8f-48e0-bc72-fd3b9cad14dd None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.075162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54639e9b-a3d4-4c63-b4ae-da50878b7e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.076407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab05e67-ff8f-48e0-bc72-fd3b9cad14dd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.076626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54639e9b-a3d4-4c63-b4ae-da50878b7e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.076737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab05e67-ff8f-48e0-bc72-fd3b9cad14dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.077638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54639e9b-a3d4-4c63-b4ae-da50878b7e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.078076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54639e9b-a3d4-4c63-b4ae-da50878b7e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.078905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54639e9b-a3d4-4c63-b4ae-da50878b7e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:30.079474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54639e9b-a3d4-4c63-b4ae-da50878b7e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.082148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54639e9b-a3d4-4c63-b4ae-da50878b7e3e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.103419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1ab05e67-ff8f-48e0-bc72-fd3b9cad14dd None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:30.103962 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1057/2109] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:09:30.104704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1ab05e67-ff8f-48e0-bc72-fd3b9cad14dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:30.105588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54639e9b-a3d4-4c63-b4ae-da50878b7e3e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.119371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1053/2110] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:30.120506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab05e67-ff8f-48e0-bc72-fd3b9cad14dd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.129881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54639e9b-a3d4-4c63-b4ae-da50878b7e3e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.138748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab05e67-ff8f-48e0-bc72-fd3b9cad14dd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.142941 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba16cd2-dd80-4dac-aee0-30b50eba3a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.143704 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba16cd2-dd80-4dac-aee0-30b50eba3a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.143986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba16cd2-dd80-4dac-aee0-30b50eba3a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.144262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba16cd2-dd80-4dac-aee0-30b50eba3a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.144943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba16cd2-dd80-4dac-aee0-30b50eba3a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.150930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5225d-f0ff-4d25-a1b6-32ff22dfa761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.151504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5225d-f0ff-4d25-a1b6-32ff22dfa761 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.151786 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5225d-f0ff-4d25-a1b6-32ff22dfa761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.152058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5225d-f0ff-4d25-a1b6-32ff22dfa761 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.155711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba16cd2-dd80-4dac-aee0-30b50eba3a5c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.157549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5225d-f0ff-4d25-a1b6-32ff22dfa761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:30.159042 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5225d-f0ff-4d25-a1b6-32ff22dfa761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.161324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5225d-f0ff-4d25-a1b6-32ff22dfa761 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.184965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1054/2111] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:30.189354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5225d-f0ff-4d25-a1b6-32ff22dfa761 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.201027 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5225d-f0ff-4d25-a1b6-32ff22dfa761 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.208343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1058/2112] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:30 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:30.211399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2354505-8223-462b-81d3-1cbbbff31b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.212083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2354505-8223-462b-81d3-1cbbbff31b6c admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.212399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2354505-8223-462b-81d3-1cbbbff31b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.212631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba16cd2-dd80-4dac-aee0-30b50eba3a5c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.212736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2354505-8223-462b-81d3-1cbbbff31b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.213436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2354505-8223-462b-81d3-1cbbbff31b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.215368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2354505-8223-462b-81d3-1cbbbff31b6c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.263762 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1055/2113] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:30 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:30.264686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2354505-8223-462b-81d3-1cbbbff31b6c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.266651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c2354505-8223-462b-81d3-1cbbbff31b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:30.303880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba16cd2-dd80-4dac-aee0-30b50eba3a5c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.367112 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2354505-8223-462b-81d3-1cbbbff31b6c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.374579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.375223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.375513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.375794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] PATH_INFO: `/v3/projects/1dca922ee56646caa3c5c64e76be1c75` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.376965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dca922ee56646caa3c5c64e76be1c75)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.378840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47695588-731c-4f31-b283-51e14f885b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.379495 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47695588-731c-4f31-b283-51e14f885b48 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.379782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47695588-731c-4f31-b283-51e14f885b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.380092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.380210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47695588-731c-4f31-b283-51e14f885b48 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.380779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47695588-731c-4f31-b283-51e14f885b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.383363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47695588-731c-4f31-b283-51e14f885b48 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.410083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1059/2114] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:30 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:30.411244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47695588-731c-4f31-b283-51e14f885b48 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.423594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47695588-731c-4f31-b283-51e14f885b48 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.435932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dca922ee56646caa3c5c64e76be1c75', 'request_id': 'req-cd22f72f-57b1-4b08-99a7-d3961477f5c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:30.442831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dca922ee56646caa3c5c64e76be1c75', 'request_id': 'req-cd22f72f-57b1-4b08-99a7-d3961477f5c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:30.449982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dca922ee56646caa3c5c64e76be1c75', 'request_id': 'req-cd22f72f-57b1-4b08-99a7-d3961477f5c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:30.462097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:30.470017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] The token cache is being invalidate because project 1dca922ee56646caa3c5c64e76be1c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:30.471111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:30.472420 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:30.474630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1056/2115] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:30 2022] DELETE /identity/v3/projects/1dca922ee56646caa3c5c64e76be1c75 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:30.476994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.478464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:30.478622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:30.495810 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00abb68-ebc3-4e2f-9d7f-8bd1cdf34472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.496607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00abb68-ebc3-4e2f-9d7f-8bd1cdf34472 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.496962 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00abb68-ebc3-4e2f-9d7f-8bd1cdf34472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.497422 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00abb68-ebc3-4e2f-9d7f-8bd1cdf34472 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.498131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00abb68-ebc3-4e2f-9d7f-8bd1cdf34472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.500195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00abb68-ebc3-4e2f-9d7f-8bd1cdf34472 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.528142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1060/2116] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:30 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:30.533172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976e747-2693-4236-96c2-ce7200ccb6c3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.533345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976e747-2693-4236-96c2-ce7200ccb6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.533540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976e747-2693-4236-96c2-ce7200ccb6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.564455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d976e747-2693-4236-96c2-ce7200ccb6c3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:30.567252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d976e747-2693-4236-96c2-ce7200ccb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:30.580008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1061/2117] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:30.581334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976e747-2693-4236-96c2-ce7200ccb6c3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.582886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d976e747-2693-4236-96c2-ce7200ccb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:30.594632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22f72f-57b1-4b08-99a7-d3961477f5c6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.604778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b7b7c-fb75-4408-ba86-f5697de49ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.605623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7b7c-fb75-4408-ba86-f5697de49ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.605748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7b7c-fb75-4408-ba86-f5697de49ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.605964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7b7c-fb75-4408-ba86-f5697de49ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.606633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b7b7c-fb75-4408-ba86-f5697de49ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.607109 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976e747-2693-4236-96c2-ce7200ccb6c3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.609345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b7b7c-fb75-4408-ba86-f5697de49ce2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.615031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93364-9aee-4bf9-b586-e0b5f3a75ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.615629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93364-9aee-4bf9-b586-e0b5f3a75ade admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.615969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93364-9aee-4bf9-b586-e0b5f3a75ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.616309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93364-9aee-4bf9-b586-e0b5f3a75ade admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.617057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f93364-9aee-4bf9-b586-e0b5f3a75ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.619210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f93364-9aee-4bf9-b586-e0b5f3a75ade admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.626530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1057/2118] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:30.629878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee219200-f2b1-450f-ad83-863bf7d5ba91 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.630508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee219200-f2b1-450f-ad83-863bf7d5ba91 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.630618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee219200-f2b1-450f-ad83-863bf7d5ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.636736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1062/2119] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:30.637787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93364-9aee-4bf9-b586-e0b5f3a75ade admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.655454 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93364-9aee-4bf9-b586-e0b5f3a75ade admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.665543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a982e32-1e0f-42e9-a4f9-52ca97a07485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.666068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982e32-1e0f-42e9-a4f9-52ca97a07485 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.668370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982e32-1e0f-42e9-a4f9-52ca97a07485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.668370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982e32-1e0f-42e9-a4f9-52ca97a07485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.670300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a982e32-1e0f-42e9-a4f9-52ca97a07485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.670446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ee219200-f2b1-450f-ad83-863bf7d5ba91 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:30.670446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ee219200-f2b1-450f-ad83-863bf7d5ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:30.670616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a982e32-1e0f-42e9-a4f9-52ca97a07485 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.686463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1058/2120] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:30.694375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee219200-f2b1-450f-ad83-863bf7d5ba91 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.707542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1063/2121] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:30.708424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a982e32-1e0f-42e9-a4f9-52ca97a07485 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.710464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee219200-f2b1-450f-ad83-863bf7d5ba91 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.719264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d5bd2-fdf4-43ca-91be-237dc34bd49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.721569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d5bd2-fdf4-43ca-91be-237dc34bd49f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.722105 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a982e32-1e0f-42e9-a4f9-52ca97a07485 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.722303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d5bd2-fdf4-43ca-91be-237dc34bd49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.723001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d5bd2-fdf4-43ca-91be-237dc34bd49f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.724088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d5bd2-fdf4-43ca-91be-237dc34bd49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.726473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d5bd2-fdf4-43ca-91be-237dc34bd49f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.727439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617a1ff-1c6a-4827-b4c2-6932e222c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.728194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617a1ff-1c6a-4827-b4c2-6932e222c7ff admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.728621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617a1ff-1c6a-4827-b4c2-6932e222c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.728993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617a1ff-1c6a-4827-b4c2-6932e222c7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.730086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617a1ff-1c6a-4827-b4c2-6932e222c7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:30.730226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617a1ff-1c6a-4827-b4c2-6932e222c7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.731942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617a1ff-1c6a-4827-b4c2-6932e222c7ff admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.742000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1059/2122] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:30.743535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d5bd2-fdf4-43ca-91be-237dc34bd49f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.759070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d5bd2-fdf4-43ca-91be-237dc34bd49f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.764638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef31b6b-b714-49cb-b4d5-096df111feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.765377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef31b6b-b714-49cb-b4d5-096df111feaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.765665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef31b6b-b714-49cb-b4d5-096df111feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.765946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef31b6b-b714-49cb-b4d5-096df111feaf admin admin] PATH_INFO: `/v3/projects/9510b7cfa13b48acb6b5b12356e9aecd/users/bed884a3d388403cbdc3d9742b53fc94/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.770831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1064/2123] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:30.770831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617a1ff-1c6a-4827-b4c2-6932e222c7ff admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.794591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef31b6b-b714-49cb-b4d5-096df111feaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9510b7cfa13b48acb6b5b12356e9aecd, user_id=bed884a3d388403cbdc3d9742b53fc94, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.802596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617a1ff-1c6a-4827-b4c2-6932e222c7ff admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:30.811023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef31b6b-b714-49cb-b4d5-096df111feaf admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.822279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29386b07-8aff-4c2a-9f58-e524b4dcb24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:30.822974 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386b07-8aff-4c2a-9f58-e524b4dcb24b admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.823262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386b07-8aff-4c2a-9f58-e524b4dcb24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.823540 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386b07-8aff-4c2a-9f58-e524b4dcb24b admin admin] PATH_INFO: `/v3/projects/f6c146590e554862955b0661b38b02c6/users/4fab10c4eea34163ae885a52270253c6/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.853891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1060/2124] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:30 2022] PUT /identity/v3/projects/9510b7cfa13b48acb6b5b12356e9aecd/users/bed884a3d388403cbdc3d9742b53fc94/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:30.854120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29386b07-8aff-4c2a-9f58-e524b4dcb24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c146590e554862955b0661b38b02c6, user_id=4fab10c4eea34163ae885a52270253c6, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:30.854252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef31b6b-b714-49cb-b4d5-096df111feaf admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:30.858139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29386b07-8aff-4c2a-9f58-e524b4dcb24b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:30.885279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1065/2125] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:30 2022] PUT /identity/v3/projects/f6c146590e554862955b0661b38b02c6/users/4fab10c4eea34163ae885a52270253c6/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:30.886841 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99a825-111c-467d-96b2-ec1d63560e25 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:30.888348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99a825-111c-467d-96b2-ec1d63560e25 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:30.889628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99a825-111c-467d-96b2-ec1d63560e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:30.947901 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-eb99a825-111c-467d-96b2-ec1d63560e25 None None] MFA Rules not processed for user `bed884a3d388403cbdc3d9742b53fc94`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:30.949351 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eb99a825-111c-467d-96b2-ec1d63560e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:31.000244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef31b6b-b714-49cb-b4d5-096df111feaf admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.052467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1066/2126] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:31.054246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268a468-a824-494f-8540-81ad98f28ec7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.055273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268a468-a824-494f-8540-81ad98f28ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.055707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268a468-a824-494f-8540-81ad98f28ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.072607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1aa71d-ff2a-4026-b156-7480c5dc7f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.073617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1aa71d-ff2a-4026-b156-7480c5dc7f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.073617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1aa71d-ff2a-4026-b156-7480c5dc7f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.073923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1aa71d-ff2a-4026-b156-7480c5dc7f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.074508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1aa71d-ff2a-4026-b156-7480c5dc7f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.076519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1aa71d-ff2a-4026-b156-7480c5dc7f34 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.082742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:31.104404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d268a468-a824-494f-8540-81ad98f28ec7 None None] MFA Rules not processed for user `4fab10c4eea34163ae885a52270253c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:31.107759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d268a468-a824-494f-8540-81ad98f28ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:31.114947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1061/2127] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:30 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:31.115825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1aa71d-ff2a-4026-b156-7480c5dc7f34 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.119694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3d1aa71d-ff2a-4026-b156-7480c5dc7f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:31.185998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:31.223933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1067/2128] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:31.223933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268a468-a824-494f-8540-81ad98f28ec7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.231697 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1aa71d-ff2a-4026-b156-7480c5dc7f34 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.236933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268a468-a824-494f-8540-81ad98f28ec7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.237154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70c8a6-6e50-4606-bac0-96ca2cbac41b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb70dd34dc642cfbb49b4e1a0434399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.237841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70c8a6-6e50-4606-bac0-96ca2cbac41b service glance] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.238225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70c8a6-6e50-4606-bac0-96ca2cbac41b service glance] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.238510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70c8a6-6e50-4606-bac0-96ca2cbac41b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.307538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70c8a6-6e50-4606-bac0-96ca2cbac41b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.307765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb30d7-4c38-4be6-b7e9-7c5fdd092eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.308451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb30d7-4c38-4be6-b7e9-7c5fdd092eab admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.308876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb30d7-4c38-4be6-b7e9-7c5fdd092eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.309028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70c8a6-6e50-4606-bac0-96ca2cbac41b service glance] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.309464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb30d7-4c38-4be6-b7e9-7c5fdd092eab admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.310206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb30d7-4c38-4be6-b7e9-7c5fdd092eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.312597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb30d7-4c38-4be6-b7e9-7c5fdd092eab admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.319683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1062/2129] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:31.320862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70c8a6-6e50-4606-bac0-96ca2cbac41b service glance] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.333862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70c8a6-6e50-4606-bac0-96ca2cbac41b service glance] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.340407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da278e-7cf4-4e42-a804-0fcaba86a81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.341238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da278e-7cf4-4e42-a804-0fcaba86a81f admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.341680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da278e-7cf4-4e42-a804-0fcaba86a81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.342099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da278e-7cf4-4e42-a804-0fcaba86a81f admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.342914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da278e-7cf4-4e42-a804-0fcaba86a81f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.345021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da278e-7cf4-4e42-a804-0fcaba86a81f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.347127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1068/2130] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:31 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:31.351577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb30d7-4c38-4be6-b7e9-7c5fdd092eab admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.365712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb30d7-4c38-4be6-b7e9-7c5fdd092eab admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.387586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2afe6c-7f2e-4175-919c-f953e10828c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.389364 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2afe6c-7f2e-4175-919c-f953e10828c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.392458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2afe6c-7f2e-4175-919c-f953e10828c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.393340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2afe6c-7f2e-4175-919c-f953e10828c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.394031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2afe6c-7f2e-4175-919c-f953e10828c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.396912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2afe6c-7f2e-4175-919c-f953e10828c0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.407320 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1063/2131] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:31 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:31.412441 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1069/2132] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:31.412581 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da278e-7cf4-4e42-a804-0fcaba86a81f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.417634 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2afe6c-7f2e-4175-919c-f953e10828c0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.434832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2afe6c-7f2e-4175-919c-f953e10828c0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.520828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9f360-e499-4dd3-9ed2-1d1b64e59ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.521643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9f360-e499-4dd3-9ed2-1d1b64e59ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.522617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9f360-e499-4dd3-9ed2-1d1b64e59ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.523325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9f360-e499-4dd3-9ed2-1d1b64e59ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.524115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9f360-e499-4dd3-9ed2-1d1b64e59ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.526517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9f360-e499-4dd3-9ed2-1d1b64e59ea2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.528005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da278e-7cf4-4e42-a804-0fcaba86a81f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.533780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8426ce5-d43c-40cc-9c5e-61bb26c1fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.534397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8426ce5-d43c-40cc-9c5e-61bb26c1fd62 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.534713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8426ce5-d43c-40cc-9c5e-61bb26c1fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.535342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8426ce5-d43c-40cc-9c5e-61bb26c1fd62 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.536014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8426ce5-d43c-40cc-9c5e-61bb26c1fd62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.538014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8426ce5-d43c-40cc-9c5e-61bb26c1fd62 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.555483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1070/2133] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:31.559893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9f360-e499-4dd3-9ed2-1d1b64e59ea2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.575835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1064/2134] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:31 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:31.577100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9f360-e499-4dd3-9ed2-1d1b64e59ea2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.580952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8426ce5-d43c-40cc-9c5e-61bb26c1fd62 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.592754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aed80-e7e4-4fae-bb0a-b496fce7a30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.593488 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aed80-e7e4-4fae-bb0a-b496fce7a30d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.593781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aed80-e7e4-4fae-bb0a-b496fce7a30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.594059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aed80-e7e4-4fae-bb0a-b496fce7a30d admin admin] PATH_INFO: `/v3/projects/24f22115e2c44624ad0a80d790e6d282/users/e8ffe46cb97c4a088d0c2638289289b0/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.596685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8426ce5-d43c-40cc-9c5e-61bb26c1fd62 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.602216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46ad1b-45a1-4acf-99de-f20830838e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.603098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ad1b-45a1-4acf-99de-f20830838e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.603558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ad1b-45a1-4acf-99de-f20830838e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.604009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ad1b-45a1-4acf-99de-f20830838e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.605132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46ad1b-45a1-4acf-99de-f20830838e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.607056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46ad1b-45a1-4acf-99de-f20830838e1a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.609823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:31.619614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aed80-e7e4-4fae-bb0a-b496fce7a30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f22115e2c44624ad0a80d790e6d282, user_id=e8ffe46cb97c4a088d0c2638289289b0, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.622648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1065/2135] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:31.626124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aed80-e7e4-4fae-bb0a-b496fce7a30d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.629098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46ad1b-45a1-4acf-99de-f20830838e1a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.656510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46ad1b-45a1-4acf-99de-f20830838e1a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.656693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1071/2136] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:31 2022] PUT /identity/v3/projects/24f22115e2c44624ad0a80d790e6d282/users/e8ffe46cb97c4a088d0c2638289289b0/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:31.667761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4aefd-d6f9-4813-b115-3eefe1a4dce5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.668048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4aefd-d6f9-4813-b115-3eefe1a4dce5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.668423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4aefd-d6f9-4813-b115-3eefe1a4dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.703287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ddf4aefd-d6f9-4813-b115-3eefe1a4dce5 None None] MFA Rules not processed for user `e8ffe46cb97c4a088d0c2638289289b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:31.704983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ddf4aefd-d6f9-4813-b115-3eefe1a4dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:31.743504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:31.786049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0218-fe63-460e-af5f-d874c5f0b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.786746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0218-fe63-460e-af5f-d874c5f0b690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.787035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0218-fe63-460e-af5f-d874c5f0b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.787556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0218-fe63-460e-af5f-d874c5f0b690 admin admin] PATH_INFO: `/v3/projects/d58385daf04c4e6b8af69d4783327d2e/users/03e6286f13fb4ac8a62de93483366ed3/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.805663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1072/2137] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:31.815124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0218-fe63-460e-af5f-d874c5f0b690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58385daf04c4e6b8af69d4783327d2e, user_id=03e6286f13fb4ac8a62de93483366ed3, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.818467 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0218-fe63-460e-af5f-d874c5f0b690 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.822655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4aefd-d6f9-4813-b115-3eefe1a4dce5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.824968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ddf4aefd-d6f9-4813-b115-3eefe1a4dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:31.840454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1066/2138] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:31 2022] PUT /identity/v3/projects/d58385daf04c4e6b8af69d4783327d2e/users/03e6286f13fb4ac8a62de93483366ed3/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:31.845344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0218-fe63-460e-af5f-d874c5f0b690 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:31.932535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0218-fe63-460e-af5f-d874c5f0b690 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.939185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec67144-4988-45de-826b-b7f7412e6207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:31.942471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec67144-4988-45de-826b-b7f7412e6207 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:31.943616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec67144-4988-45de-826b-b7f7412e6207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:31.944040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec67144-4988-45de-826b-b7f7412e6207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:31.944914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec67144-4988-45de-826b-b7f7412e6207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:31.946970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec67144-4988-45de-826b-b7f7412e6207 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:31.954332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4aefd-d6f9-4813-b115-3eefe1a4dce5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:31.963230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1067/2139] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:31.969011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec67144-4988-45de-826b-b7f7412e6207 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:32.003006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec67144-4988-45de-826b-b7f7412e6207 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:32.009997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97de24-1304-4812-af3e-7dff9c9f1812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:32.010671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97de24-1304-4812-af3e-7dff9c9f1812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:32.010953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97de24-1304-4812-af3e-7dff9c9f1812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:32.011233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97de24-1304-4812-af3e-7dff9c9f1812 admin admin] PATH_INFO: `/v3/projects/d58385daf04c4e6b8af69d4783327d2e/users/03e6286f13fb4ac8a62de93483366ed3/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:32.014460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97de24-1304-4812-af3e-7dff9c9f1812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58385daf04c4e6b8af69d4783327d2e, user_id=03e6286f13fb4ac8a62de93483366ed3, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:32.018286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97de24-1304-4812-af3e-7dff9c9f1812 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:32.032312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1068/2140] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:31 2022] PUT /identity/v3/projects/d58385daf04c4e6b8af69d4783327d2e/users/03e6286f13fb4ac8a62de93483366ed3/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:32.045406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4900d-4d95-446b-a7fe-2be3e782ab4e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:32.045547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4900d-4d95-446b-a7fe-2be3e782ab4e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:32.045719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4900d-4d95-446b-a7fe-2be3e782ab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:32.086502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab376cc4-b6ff-423f-b873-30deb947bbfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:32.087279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376cc4-b6ff-423f-b873-30deb947bbfb service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:32.087573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376cc4-b6ff-423f-b873-30deb947bbfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:32.087853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376cc4-b6ff-423f-b873-30deb947bbfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:32.089946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9ff4900d-4d95-446b-a7fe-2be3e782ab4e None None] MFA Rules not processed for user `03e6286f13fb4ac8a62de93483366ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:32.094619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9ff4900d-4d95-446b-a7fe-2be3e782ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:32.168616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:32.197524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1069/2141] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:32.202999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab376cc4-b6ff-423f-b873-30deb947bbfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:32.204722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab376cc4-b6ff-423f-b873-30deb947bbfb service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:32.212589 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4900d-4d95-446b-a7fe-2be3e782ab4e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:32.214811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9ff4900d-4d95-446b-a7fe-2be3e782ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:32.246213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1073/2142] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:32.373520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4900d-4d95-446b-a7fe-2be3e782ab4e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:32.386917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb95bb1-ae7c-442a-9ca6-27c6a501143e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:32.387555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb95bb1-ae7c-442a-9ca6-27c6a501143e service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:32.387839 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb95bb1-ae7c-442a-9ca6-27c6a501143e service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:32.388115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb95bb1-ae7c-442a-9ca6-27c6a501143e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:32.421150 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb95bb1-ae7c-442a-9ca6-27c6a501143e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:32.422739 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb95bb1-ae7c-442a-9ca6-27c6a501143e service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:32.437386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1070/2143] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:09:32.659015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab376cc4-b6ff-423f-b873-30deb947bbfb service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:32.684454 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab376cc4-b6ff-423f-b873-30deb947bbfb service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:32.688832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c635a96-5162-46e5-8afb-36cbb218b305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:32.689446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635a96-5162-46e5-8afb-36cbb218b305 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:32.689894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635a96-5162-46e5-8afb-36cbb218b305 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:32.690249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635a96-5162-46e5-8afb-36cbb218b305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:32.781411 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:32.829104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c635a96-5162-46e5-8afb-36cbb218b305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:32.830791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c635a96-5162-46e5-8afb-36cbb218b305 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:32.857063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1074/2144] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:34.391697 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29cd3-0eda-4a56-9570-a87f9b805e81 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:34.392247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29cd3-0eda-4a56-9570-a87f9b805e81 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:34.392739 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29cd3-0eda-4a56-9570-a87f9b805e81 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:34.395116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1071/2145] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:09:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:09:34.423896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911a61-3707-4c6e-808b-4333390c0f75 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:34.425008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911a61-3707-4c6e-808b-4333390c0f75 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:34.425458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911a61-3707-4c6e-808b-4333390c0f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:34.461992 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5d911a61-3707-4c6e-808b-4333390c0f75 None None] MFA Rules not processed for user `1eb93baf45174c10a6fcbe321ac65764`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:34.463387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d911a61-3707-4c6e-808b-4333390c0f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:34.494898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f29cd3-0eda-4a56-9570-a87f9b805e81 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:34.497735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-03f29cd3-0eda-4a56-9570-a87f9b805e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:34.553659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1075/2146] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:34.570956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d911a61-3707-4c6e-808b-4333390c0f75 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:34.573425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d911a61-3707-4c6e-808b-4333390c0f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:34.592215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d911a61-3707-4c6e-808b-4333390c0f75 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:34.604599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5ab79-8238-42ad-a762-f4f3921fe559 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:34.607066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5ab79-8238-42ad-a762-f4f3921fe559 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:34.607066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5ab79-8238-42ad-a762-f4f3921fe559 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:34.607066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5ab79-8238-42ad-a762-f4f3921fe559 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:34.616899 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f29cd3-0eda-4a56-9570-a87f9b805e81 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:34.621150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5ab79-8238-42ad-a762-f4f3921fe559 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:34.623041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:34.623649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:34.623929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:34.624210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] PATH_INFO: `/v3/users/4c1ede96ad444ec4891622798ee0ed90` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:34.624881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5ab79-8238-42ad-a762-f4f3921fe559 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:34.627452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1ede96ad444ec4891622798ee0ed90)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:34.629990 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:34.638253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1076/2147] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:34.700826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1ede96ad444ec4891622798ee0ed90'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:34.701944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1ede96ad444ec4891622798ee0ed90'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:34.713522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1ede96ad444ec4891622798ee0ed90'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:34.722535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1ede96ad444ec4891622798ee0ed90'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:34.735236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1965b38d-9220-41a3-b13d-f935570105a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1ede96ad444ec4891622798ee0ed90'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:34.743818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1072/2148] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:34 2022] DELETE /identity/v3/users/4c1ede96ad444ec4891622798ee0ed90 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:34.954947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5ab79-8238-42ad-a762-f4f3921fe559 service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:34.967852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5ab79-8238-42ad-a762-f4f3921fe559 service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:35.024896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:35.025450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.025736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.026018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] PATH_INFO: `/v3/projects/e75e26d9147d4f1bbef5b4ccb2f2c509` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.027139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75e26d9147d4f1bbef5b4ccb2f2c509)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:35.029094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:35.075766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75e26d9147d4f1bbef5b4ccb2f2c509', 'request_id': 'req-b03ff6a1-932a-40c4-bf58-3377c44635e7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:35.081314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75e26d9147d4f1bbef5b4ccb2f2c509', 'request_id': 'req-b03ff6a1-932a-40c4-bf58-3377c44635e7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:35.085128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:35.089154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75e26d9147d4f1bbef5b4ccb2f2c509', 'request_id': 'req-b03ff6a1-932a-40c4-bf58-3377c44635e7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:35.103535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] The token cache is being invalidate because project e75e26d9147d4f1bbef5b4ccb2f2c509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:35.103827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:35.104572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b03ff6a1-932a-40c4-bf58-3377c44635e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:35.106028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1077/2149] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:34 2022] DELETE /identity/v3/projects/e75e26d9147d4f1bbef5b4ccb2f2c509 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:35.110935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcf578-a0d3-4709-865b-42130c711af0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.111234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcf578-a0d3-4709-865b-42130c711af0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.112076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcf578-a0d3-4709-865b-42130c711af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.131855 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-13fcf578-a0d3-4709-865b-42130c711af0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:35.133159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-13fcf578-a0d3-4709-865b-42130c711af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:35.139216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:35.201958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1073/2150] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:35.211658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d2d23-0ae6-44c5-bd2c-d3b17b6e058e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.211951 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d2d23-0ae6-44c5-bd2c-d3b17b6e058e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.212227 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d2d23-0ae6-44c5-bd2c-d3b17b6e058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.232818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bd7d2d23-0ae6-44c5-bd2c-d3b17b6e058e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:35.234058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bd7d2d23-0ae6-44c5-bd2c-d3b17b6e058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:35.246940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1078/2151] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:35.253607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcf578-a0d3-4709-865b-42130c711af0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:35.264383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcf578-a0d3-4709-865b-42130c711af0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:35.272869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d6cfc-c78c-4223-8c74-4c8be6caf601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:35.273541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d6cfc-c78c-4223-8c74-4c8be6caf601 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.273831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d6cfc-c78c-4223-8c74-4c8be6caf601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.274147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d6cfc-c78c-4223-8c74-4c8be6caf601 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.275058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d6cfc-c78c-4223-8c74-4c8be6caf601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:35.275321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d6cfc-c78c-4223-8c74-4c8be6caf601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:35.277028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d6cfc-c78c-4223-8c74-4c8be6caf601 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:35.291592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1074/2152] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:09:35.295982 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d2d23-0ae6-44c5-bd2c-d3b17b6e058e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:35.306663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d2d23-0ae6-44c5-bd2c-d3b17b6e058e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:35.312863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bee5e2-fa40-455d-8fdf-9f3e2375d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:35.313476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bee5e2-fa40-455d-8fdf-9f3e2375d7cd admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.313758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bee5e2-fa40-455d-8fdf-9f3e2375d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.314031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bee5e2-fa40-455d-8fdf-9f3e2375d7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.315266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bee5e2-fa40-455d-8fdf-9f3e2375d7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:35.317137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bee5e2-fa40-455d-8fdf-9f3e2375d7cd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:35.347502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1079/2153] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:35 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:35.351983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d6cfc-c78c-4223-8c74-4c8be6caf601 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:35.364468 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d6cfc-c78c-4223-8c74-4c8be6caf601 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:35.454207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef992364-05e6-47af-abdf-b992b645b9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:35.454885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef992364-05e6-47af-abdf-b992b645b9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.455812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef992364-05e6-47af-abdf-b992b645b9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.456235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef992364-05e6-47af-abdf-b992b645b9e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.456922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef992364-05e6-47af-abdf-b992b645b9e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:35.459111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef992364-05e6-47af-abdf-b992b645b9e0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:35.480116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1075/2154] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:35 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:35.484409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bee5e2-fa40-455d-8fdf-9f3e2375d7cd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:35.498390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bee5e2-fa40-455d-8fdf-9f3e2375d7cd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:35.513352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1686cb-7b27-4a88-a68b-391cade22399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:35.514015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1686cb-7b27-4a88-a68b-391cade22399 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.514299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1686cb-7b27-4a88-a68b-391cade22399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.514575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1686cb-7b27-4a88-a68b-391cade22399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.515232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1686cb-7b27-4a88-a68b-391cade22399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:35.516895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1686cb-7b27-4a88-a68b-391cade22399 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:35.529821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1080/2155] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:35.534482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef992364-05e6-47af-abdf-b992b645b9e0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:35.545612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef992364-05e6-47af-abdf-b992b645b9e0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:35.552392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fccd7-b5f3-49fb-8750-7ad4b0b88318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:35.553108 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fccd7-b5f3-49fb-8750-7ad4b0b88318 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.553294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fccd7-b5f3-49fb-8750-7ad4b0b88318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.553671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fccd7-b5f3-49fb-8750-7ad4b0b88318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.554213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fccd7-b5f3-49fb-8750-7ad4b0b88318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:35.555824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fccd7-b5f3-49fb-8750-7ad4b0b88318 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:35.567573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1076/2156] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:35.571778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1686cb-7b27-4a88-a68b-391cade22399 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:35.583189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1686cb-7b27-4a88-a68b-391cade22399 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:35.591357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787ec6a-f27e-44bf-8aca-06f9dc24cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:35.592062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ec6a-f27e-44bf-8aca-06f9dc24cb51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.592396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ec6a-f27e-44bf-8aca-06f9dc24cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.593187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ec6a-f27e-44bf-8aca-06f9dc24cb51 admin admin] PATH_INFO: `/v3/projects/f468feecf59a43bebf46f6f8e3a8f835/users/dba58e04797b471aa4271a82d5ec45e7/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.609519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787ec6a-f27e-44bf-8aca-06f9dc24cb51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f468feecf59a43bebf46f6f8e3a8f835, user_id=dba58e04797b471aa4271a82d5ec45e7, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:35.613256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787ec6a-f27e-44bf-8aca-06f9dc24cb51 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:35.626921 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1081/2157] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:35 2022] PUT /identity/v3/projects/f468feecf59a43bebf46f6f8e3a8f835/users/dba58e04797b471aa4271a82d5ec45e7/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:35.638526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667cd5c-a52a-4b5e-83e0-51c6e8f1c9a5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.638838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667cd5c-a52a-4b5e-83e0-51c6e8f1c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.639186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667cd5c-a52a-4b5e-83e0-51c6e8f1c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.676191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4667cd5c-a52a-4b5e-83e0-51c6e8f1c9a5 None None] MFA Rules not processed for user `dba58e04797b471aa4271a82d5ec45e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:35.677873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4667cd5c-a52a-4b5e-83e0-51c6e8f1c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:35.678253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787ec6a-f27e-44bf-8aca-06f9dc24cb51 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:35.681584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3787ec6a-f27e-44bf-8aca-06f9dc24cb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:35.756201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1077/2158] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:35.761489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787ec6a-f27e-44bf-8aca-06f9dc24cb51 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:35.766171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:35.767087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.767376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.768201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] PATH_INFO: `/v3/users/4fab10c4eea34163ae885a52270253c6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.771721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667cd5c-a52a-4b5e-83e0-51c6e8f1c9a5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:35.771892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fab10c4eea34163ae885a52270253c6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:35.771993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4667cd5c-a52a-4b5e-83e0-51c6e8f1c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:35.772082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:35.782138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:35.823510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fab10c4eea34163ae885a52270253c6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:35.824616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fab10c4eea34163ae885a52270253c6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:35.834603 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fab10c4eea34163ae885a52270253c6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:35.849883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fab10c4eea34163ae885a52270253c6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:35.857547 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-030c2077-3f75-4e39-9f71-f3d98f3070b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fab10c4eea34163ae885a52270253c6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:35.863560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667cd5c-a52a-4b5e-83e0-51c6e8f1c9a5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:35.869918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1082/2159] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:35 2022] DELETE /identity/v3/users/4fab10c4eea34163ae885a52270253c6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:35.874053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2d4f-fd7c-49b8-aec9-79010b415b82 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.874405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2d4f-fd7c-49b8-aec9-79010b415b82 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.874688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2d4f-fd7c-49b8-aec9-79010b415b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.881536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b601957-cbcb-4372-8831-93309705ddbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:35.882179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b601957-cbcb-4372-8831-93309705ddbb service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:35.882525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b601957-cbcb-4372-8831-93309705ddbb service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:35.882870 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b601957-cbcb-4372-8831-93309705ddbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:35.884912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1b601957-cbcb-4372-8831-93309705ddbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:35.895651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:35.899178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b601957-cbcb-4372-8831-93309705ddbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:35.902409 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b601957-cbcb-4372-8831-93309705ddbb service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:35.902560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fd4b2d4f-fd7c-49b8-aec9-79010b415b82 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:35.904268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fd4b2d4f-fd7c-49b8-aec9-79010b415b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:35.914726 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1078/2160] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:09:35.981368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1083/2161] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:35.993682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b601957-cbcb-4372-8831-93309705ddbb service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:35.995114 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1b601957-cbcb-4372-8831-93309705ddbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:36.057914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b601957-cbcb-4372-8831-93309705ddbb service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:36.131547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b4c3f-edb3-47f2-8aed-3cce83a53986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:36.132241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b4c3f-edb3-47f2-8aed-3cce83a53986 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:36.132609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b4c3f-edb3-47f2-8aed-3cce83a53986 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:36.132916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b4c3f-edb3-47f2-8aed-3cce83a53986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:36.143492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b4c3f-edb3-47f2-8aed-3cce83a53986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:36.145005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b4c3f-edb3-47f2-8aed-3cce83a53986 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:36.159171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1079/2162] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:36.238174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b2d4f-fd7c-49b8-aec9-79010b415b82 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:36.239418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fd4b2d4f-fd7c-49b8-aec9-79010b415b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:36.379759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b2d4f-fd7c-49b8-aec9-79010b415b82 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:36.394895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4fcb5-31ac-4fd2-b10f-82ca085341e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:36.395539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4fcb5-31ac-4fd2-b10f-82ca085341e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:36.395822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4fcb5-31ac-4fd2-b10f-82ca085341e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:36.396099 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4fcb5-31ac-4fd2-b10f-82ca085341e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:36.398132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fef4fcb5-31ac-4fd2-b10f-82ca085341e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:36.515213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4fcb5-31ac-4fd2-b10f-82ca085341e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:36.517252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4fcb5-31ac-4fd2-b10f-82ca085341e2 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:36.530922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1084/2163] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:36.565600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b4c3f-edb3-47f2-8aed-3cce83a53986 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:36.567244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a22b4c3f-edb3-47f2-8aed-3cce83a53986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:36.586648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b4c3f-edb3-47f2-8aed-3cce83a53986 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:36.592638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:36.593568 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:36.595204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:36.597126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] PATH_INFO: `/v3/projects/f6c146590e554862955b0661b38b02c6` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:36.599077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c146590e554862955b0661b38b02c6)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:36.601229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:36.654530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:36.664368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c146590e554862955b0661b38b02c6', 'request_id': 'req-e8f30da3-4824-46a8-909c-9225c3bee8b4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:36.675661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c146590e554862955b0661b38b02c6', 'request_id': 'req-e8f30da3-4824-46a8-909c-9225c3bee8b4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:36.696054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c146590e554862955b0661b38b02c6', 'request_id': 'req-e8f30da3-4824-46a8-909c-9225c3bee8b4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:36.713449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] The token cache is being invalidate because project f6c146590e554862955b0661b38b02c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:36.713826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:36.714550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:36.716283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1080/2164] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:36 2022] DELETE /identity/v3/projects/f6c146590e554862955b0661b38b02c6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:36.719994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4fcb5-31ac-4fd2-b10f-82ca085341e2 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:36.731292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4fcb5-31ac-4fd2-b10f-82ca085341e2 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:36.793480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:36.801413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:36.802211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:36.802559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:36.802845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] PATH_INFO: `/v3/users/03e6286f13fb4ac8a62de93483366ed3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:36.804129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e6286f13fb4ac8a62de93483366ed3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:36.806230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:36.857175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e6286f13fb4ac8a62de93483366ed3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:36.857874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e6286f13fb4ac8a62de93483366ed3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:36.867021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e6286f13fb4ac8a62de93483366ed3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:36.885177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e6286f13fb4ac8a62de93483366ed3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:36.892510 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7cf086b9-d2a1-4265-894d-cb89d3396b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e6286f13fb4ac8a62de93483366ed3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:36.899518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1085/2165] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:36 2022] DELETE /identity/v3/users/03e6286f13fb4ac8a62de93483366ed3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:37.179114 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:37.181677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:37.194292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f30da3-4824-46a8-909c-9225c3bee8b4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:37.266274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:37.267078 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:37.267365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:37.268503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] PATH_INFO: `/v3/projects/d58385daf04c4e6b8af69d4783327d2e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:37.269782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58385daf04c4e6b8af69d4783327d2e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:37.271687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:37.324634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58385daf04c4e6b8af69d4783327d2e', 'request_id': 'req-ed4b6d99-bd71-49fb-82b3-7185c8d729af'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:37.331293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58385daf04c4e6b8af69d4783327d2e', 'request_id': 'req-ed4b6d99-bd71-49fb-82b3-7185c8d729af'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:37.338116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58385daf04c4e6b8af69d4783327d2e', 'request_id': 'req-ed4b6d99-bd71-49fb-82b3-7185c8d729af'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:37.353163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] The token cache is being invalidate because project d58385daf04c4e6b8af69d4783327d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:37.353526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:37.354268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ed4b6d99-bd71-49fb-82b3-7185c8d729af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:37.356040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1081/2166] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:37 2022] DELETE /identity/v3/projects/d58385daf04c4e6b8af69d4783327d2e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:37.360772 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c3b3-ed53-4d76-8add-94fcfb13f904 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:37.361122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c3b3-ed53-4d76-8add-94fcfb13f904 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:37.362115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c3b3-ed53-4d76-8add-94fcfb13f904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:37.383142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-65c3c3b3-ed53-4d76-8add-94fcfb13f904 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:37.384345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-65c3c3b3-ed53-4d76-8add-94fcfb13f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:37.452785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1086/2167] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:37.462363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15891e-2d63-40ff-a765-3a5964b92fb9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:37.462668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15891e-2d63-40ff-a765-3a5964b92fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:37.462953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15891e-2d63-40ff-a765-3a5964b92fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:37.488432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-de15891e-2d63-40ff-a765-3a5964b92fb9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:37.489665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-de15891e-2d63-40ff-a765-3a5964b92fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:37.503485 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1082/2168] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:37.507847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c3b3-ed53-4d76-8add-94fcfb13f904 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:37.520890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c3b3-ed53-4d76-8add-94fcfb13f904 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:37.531436 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c1350-25e1-4811-ab14-603eb6ebf1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:37.532135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c1350-25e1-4811-ab14-603eb6ebf1ef admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:37.532760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c1350-25e1-4811-ab14-603eb6ebf1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:37.534891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c1350-25e1-4811-ab14-603eb6ebf1ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:37.535917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c1350-25e1-4811-ab14-603eb6ebf1ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:37.536399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c1350-25e1-4811-ab14-603eb6ebf1ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:37.539342 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c1350-25e1-4811-ab14-603eb6ebf1ef admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:37.562041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1087/2169] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:37.562878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15891e-2d63-40ff-a765-3a5964b92fb9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:37.574062 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15891e-2d63-40ff-a765-3a5964b92fb9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:37.579558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3984c-2429-475d-84fc-ab2a6fcaa5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:37.580779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3984c-2429-475d-84fc-ab2a6fcaa5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:37.581063 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3984c-2429-475d-84fc-ab2a6fcaa5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:37.581499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3984c-2429-475d-84fc-ab2a6fcaa5d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:37.582148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3984c-2429-475d-84fc-ab2a6fcaa5d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:37.584683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3984c-2429-475d-84fc-ab2a6fcaa5d4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:37.632205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c1350-25e1-4811-ab14-603eb6ebf1ef admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:37.643250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c1350-25e1-4811-ab14-603eb6ebf1ef admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:37.643971 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1083/2170] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:37 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:37.730405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096154-199c-4d0d-a7e9-56c773d1fbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:37.731080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096154-199c-4d0d-a7e9-56c773d1fbad admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:37.731423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096154-199c-4d0d-a7e9-56c773d1fbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:37.731707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096154-199c-4d0d-a7e9-56c773d1fbad admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:37.732820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df096154-199c-4d0d-a7e9-56c773d1fbad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:37.736153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df096154-199c-4d0d-a7e9-56c773d1fbad admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:37.751726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:37.771475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1088/2171] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:37 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:37.775507 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3984c-2429-475d-84fc-ab2a6fcaa5d4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:37.786690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3984c-2429-475d-84fc-ab2a6fcaa5d4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:37.791624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dbecc-bee2-4686-83f7-9bdd2014dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:37.792225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dbecc-bee2-4686-83f7-9bdd2014dbfe admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:37.792537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dbecc-bee2-4686-83f7-9bdd2014dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:37.792812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dbecc-bee2-4686-83f7-9bdd2014dbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:37.793454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dbecc-bee2-4686-83f7-9bdd2014dbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:37.795035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dbecc-bee2-4686-83f7-9bdd2014dbfe admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:37.805215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1084/2172] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:37.809213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096154-199c-4d0d-a7e9-56c773d1fbad admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:37.819678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096154-199c-4d0d-a7e9-56c773d1fbad admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:37.824300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7bb67-e388-4ee2-919a-32d2c7c50eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:37.826498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7bb67-e388-4ee2-919a-32d2c7c50eba admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:37.826776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7bb67-e388-4ee2-919a-32d2c7c50eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:37.827048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7bb67-e388-4ee2-919a-32d2c7c50eba admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:37.827685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7bb67-e388-4ee2-919a-32d2c7c50eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:37.829295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7bb67-e388-4ee2-919a-32d2c7c50eba admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:37.840954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1089/2173] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:37.845097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dbecc-bee2-4686-83f7-9bdd2014dbfe admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:37.855939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dbecc-bee2-4686-83f7-9bdd2014dbfe admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:37.860679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b902e6-a31d-403f-9081-3dba00255a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:37.861926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b902e6-a31d-403f-9081-3dba00255a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:37.862185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b902e6-a31d-403f-9081-3dba00255a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:37.862633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b902e6-a31d-403f-9081-3dba00255a80 admin admin] PATH_INFO: `/v3/projects/99b1638bf709458eb910dea06a1f026f/users/8b5260cc6ff040cb817d14656518af90/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:37.880618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b902e6-a31d-403f-9081-3dba00255a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b1638bf709458eb910dea06a1f026f, user_id=8b5260cc6ff040cb817d14656518af90, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:37.883596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b902e6-a31d-403f-9081-3dba00255a80 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:37.893207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:37.898327 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1085/2174] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:37 2022] PUT /identity/v3/projects/99b1638bf709458eb910dea06a1f026f/users/8b5260cc6ff040cb817d14656518af90/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:37.908809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ff0d-6c1e-4009-90ce-cc7a401329f3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:37.909380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ff0d-6c1e-4009-90ce-cc7a401329f3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:37.909727 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ff0d-6c1e-4009-90ce-cc7a401329f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:37.938954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bcd4ff0d-6c1e-4009-90ce-cc7a401329f3 None None] MFA Rules not processed for user `8b5260cc6ff040cb817d14656518af90`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:37.941021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bcd4ff0d-6c1e-4009-90ce-cc7a401329f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:38.028071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1090/2175] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:38.041165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b902e6-a31d-403f-9081-3dba00255a80 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:38.043419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-42b902e6-a31d-403f-9081-3dba00255a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:38.102385 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b902e6-a31d-403f-9081-3dba00255a80 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:38.106081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11dfac-8055-45b7-880e-8b0be19b2305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:38.106653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11dfac-8055-45b7-880e-8b0be19b2305 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:38.106940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11dfac-8055-45b7-880e-8b0be19b2305 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:38.107210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11dfac-8055-45b7-880e-8b0be19b2305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:38.116263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11dfac-8055-45b7-880e-8b0be19b2305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:38.117735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11dfac-8055-45b7-880e-8b0be19b2305 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:38.126945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1086/2176] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:09:38.148545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4ff0d-6c1e-4009-90ce-cc7a401329f3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:38.213034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4ff0d-6c1e-4009-90ce-cc7a401329f3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:38.217613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:38.218299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:38.218580 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:38.218853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] PATH_INFO: `/v3/users/8b5260cc6ff040cb817d14656518af90` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:38.219998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5260cc6ff040cb817d14656518af90)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:38.222694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:38.269760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5260cc6ff040cb817d14656518af90'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:38.270910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5260cc6ff040cb817d14656518af90'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:38.279365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5260cc6ff040cb817d14656518af90'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:38.292994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5260cc6ff040cb817d14656518af90'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:38.294923 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:38.301505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5260cc6ff040cb817d14656518af90'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:38.312292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1091/2177] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:38 2022] DELETE /identity/v3/users/8b5260cc6ff040cb817d14656518af90 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:38.317935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b4da-6d70-4dce-8369-7eb565d8c85f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:38.318221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b4da-6d70-4dce-8369-7eb565d8c85f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:38.318495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b4da-6d70-4dce-8369-7eb565d8c85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:38.338307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9458b4da-6d70-4dce-8369-7eb565d8c85f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:38.339713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9458b4da-6d70-4dce-8369-7eb565d8c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:38.401006 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1087/2178] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:38.410759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:38.412832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:38.474497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76394963-607f-4a12-b112-ac2a61762022 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:38.478239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e295d-1acf-4ed1-a5f4-8f2ee5659683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:38.478849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e295d-1acf-4ed1-a5f4-8f2ee5659683 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:38.479135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e295d-1acf-4ed1-a5f4-8f2ee5659683 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:38.479415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e295d-1acf-4ed1-a5f4-8f2ee5659683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:38.488844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e295d-1acf-4ed1-a5f4-8f2ee5659683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:38.490277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e295d-1acf-4ed1-a5f4-8f2ee5659683 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:38.499993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1092/2179] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:38.784657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458b4da-6d70-4dce-8369-7eb565d8c85f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:38.788201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9458b4da-6d70-4dce-8369-7eb565d8c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:38.807128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458b4da-6d70-4dce-8369-7eb565d8c85f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:38.813801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:38.814977 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:38.815351 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:38.815568 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] PATH_INFO: `/v3/projects/99b1638bf709458eb910dea06a1f026f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:38.816894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b1638bf709458eb910dea06a1f026f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:38.819076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:38.843850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e295d-1acf-4ed1-a5f4-8f2ee5659683 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:38.845515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2f9e295d-1acf-4ed1-a5f4-8f2ee5659683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:38.865082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e295d-1acf-4ed1-a5f4-8f2ee5659683 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:38.890686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b1638bf709458eb910dea06a1f026f', 'request_id': 'req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:38.898619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b1638bf709458eb910dea06a1f026f', 'request_id': 'req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:38.906326 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b1638bf709458eb910dea06a1f026f', 'request_id': 'req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:38.926873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] The token cache is being invalidate because project 99b1638bf709458eb910dea06a1f026f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:38.927393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:38.928468 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c7c75bdb-b38c-45fe-9fe9-0eafb2e7576e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:38.930332 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1088/2180] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:38 2022] DELETE /identity/v3/projects/99b1638bf709458eb910dea06a1f026f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:38.934641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a5913-1e68-4f00-82c5-edba488b8142 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:38.934931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a5913-1e68-4f00-82c5-edba488b8142 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:38.935213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a5913-1e68-4f00-82c5-edba488b8142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:38.958630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3b9a5913-1e68-4f00-82c5-edba488b8142 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:38.960059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3b9a5913-1e68-4f00-82c5-edba488b8142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:38.960158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:38.960781 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:38.961155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:38.961602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] PATH_INFO: `/v3/users/dba58e04797b471aa4271a82d5ec45e7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:38.963117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba58e04797b471aa4271a82d5ec45e7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:38.965361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:38.972603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1089/2181] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:38.979418 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d510aa-fe9f-4c33-a715-2ba309b8c78f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:38.980156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d510aa-fe9f-4c33-a715-2ba309b8c78f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:38.980488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d510aa-fe9f-4c33-a715-2ba309b8c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.013255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a4d510aa-fe9f-4c33-a715-2ba309b8c78f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:39.014754 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a4d510aa-fe9f-4c33-a715-2ba309b8c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:39.024637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1090/2182] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:39.039556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d510aa-fe9f-4c33-a715-2ba309b8c78f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:39.042778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba58e04797b471aa4271a82d5ec45e7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:39.043440 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba58e04797b471aa4271a82d5ec45e7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:39.051495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d510aa-fe9f-4c33-a715-2ba309b8c78f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:39.056168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba58e04797b471aa4271a82d5ec45e7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:39.057672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1efc6-9208-43c5-8537-4807a9712d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:39.058504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1efc6-9208-43c5-8537-4807a9712d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.059014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1efc6-9208-43c5-8537-4807a9712d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.059234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1efc6-9208-43c5-8537-4807a9712d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.059952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1efc6-9208-43c5-8537-4807a9712d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:39.060234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1efc6-9208-43c5-8537-4807a9712d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:39.061889 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1efc6-9208-43c5-8537-4807a9712d3f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:39.072519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:39.078201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1091/2183] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:39.083127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1efc6-9208-43c5-8537-4807a9712d3f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:39.084144 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba58e04797b471aa4271a82d5ec45e7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:39.093710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7923f5ed-543c-4f0f-a43e-d1eac2b92aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba58e04797b471aa4271a82d5ec45e7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:39.099894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1efc6-9208-43c5-8537-4807a9712d3f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:39.104717 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1093/2184] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:38 2022] DELETE /identity/v3/users/dba58e04797b471aa4271a82d5ec45e7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:39.109592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911456af-bb51-4a40-b7da-12f17b3fd487 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.111280 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911456af-bb51-4a40-b7da-12f17b3fd487 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.112564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911456af-bb51-4a40-b7da-12f17b3fd487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.114519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090cee3-56e3-4772-b59a-a998f9c1b7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:39.115362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090cee3-56e3-4772-b59a-a998f9c1b7ad admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.115867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090cee3-56e3-4772-b59a-a998f9c1b7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.116239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090cee3-56e3-4772-b59a-a998f9c1b7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.117140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090cee3-56e3-4772-b59a-a998f9c1b7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:39.119208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090cee3-56e3-4772-b59a-a998f9c1b7ad admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:39.162177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1092/2185] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:39 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:39.165321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090cee3-56e3-4772-b59a-a998f9c1b7ad admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:39.167166 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-911456af-bb51-4a40-b7da-12f17b3fd487 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:39.167677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6090cee3-56e3-4772-b59a-a998f9c1b7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:39.168458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-911456af-bb51-4a40-b7da-12f17b3fd487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:39.180224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:39.292511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1094/2186] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:39.292511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911456af-bb51-4a40-b7da-12f17b3fd487 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:39.292511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-911456af-bb51-4a40-b7da-12f17b3fd487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:39.304548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090cee3-56e3-4772-b59a-a998f9c1b7ad admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:39.311239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb847a-373c-4035-94db-aada657eb8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:39.311665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb847a-373c-4035-94db-aada657eb8aa admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.312095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb847a-373c-4035-94db-aada657eb8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.312190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb847a-373c-4035-94db-aada657eb8aa admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.312872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb847a-373c-4035-94db-aada657eb8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:39.314834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb847a-373c-4035-94db-aada657eb8aa admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:39.342014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1093/2187] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:39 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:39.346913 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb847a-373c-4035-94db-aada657eb8aa admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:39.356983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb847a-373c-4035-94db-aada657eb8aa admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:39.361892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00bdbb-a79a-4a2f-9abe-4c98b74cb681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:39.362589 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00bdbb-a79a-4a2f-9abe-4c98b74cb681 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.362891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00bdbb-a79a-4a2f-9abe-4c98b74cb681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.363146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00bdbb-a79a-4a2f-9abe-4c98b74cb681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.363263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911456af-bb51-4a40-b7da-12f17b3fd487 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:39.363857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00bdbb-a79a-4a2f-9abe-4c98b74cb681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:39.365408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00bdbb-a79a-4a2f-9abe-4c98b74cb681 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:39.367173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8526441-c58e-4385-b0b3-bf06a7840128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:39.368252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526441-c58e-4385-b0b3-bf06a7840128 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.368573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526441-c58e-4385-b0b3-bf06a7840128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.368854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526441-c58e-4385-b0b3-bf06a7840128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.375938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1094/2188] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:39.379800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8526441-c58e-4385-b0b3-bf06a7840128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:39.379969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00bdbb-a79a-4a2f-9abe-4c98b74cb681 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:39.381271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8526441-c58e-4385-b0b3-bf06a7840128 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:39.389966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00bdbb-a79a-4a2f-9abe-4c98b74cb681 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:39.391180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1095/2189] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:39.395371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3345cd8-fcd2-4e92-8cf6-e7dc6e04b5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:39.395969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345cd8-fcd2-4e92-8cf6-e7dc6e04b5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.396255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345cd8-fcd2-4e92-8cf6-e7dc6e04b5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.396570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345cd8-fcd2-4e92-8cf6-e7dc6e04b5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.397213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3345cd8-fcd2-4e92-8cf6-e7dc6e04b5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:39.398940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3345cd8-fcd2-4e92-8cf6-e7dc6e04b5c6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:39.413335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1095/2190] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:39.414401 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8526441-c58e-4385-b0b3-bf06a7840128 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:39.424143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8526441-c58e-4385-b0b3-bf06a7840128 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:39.429365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f983d6-e84a-4ca5-9813-d4857c143182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:39.430055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f983d6-e84a-4ca5-9813-d4857c143182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.430338 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f983d6-e84a-4ca5-9813-d4857c143182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.430613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f983d6-e84a-4ca5-9813-d4857c143182 admin admin] PATH_INFO: `/v3/projects/db7a23e98b1142e79a37dd55738fad8d/users/92c9f14ec76d4a28a189eda5aeaaecd9/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.447205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f983d6-e84a-4ca5-9813-d4857c143182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7a23e98b1142e79a37dd55738fad8d, user_id=92c9f14ec76d4a28a189eda5aeaaecd9, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:39.450137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f983d6-e84a-4ca5-9813-d4857c143182 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:39.464823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1096/2191] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:39 2022] PUT /identity/v3/projects/db7a23e98b1142e79a37dd55738fad8d/users/92c9f14ec76d4a28a189eda5aeaaecd9/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:39.476643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd0f8f-8afa-4eb6-907f-8c1961891648 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.476956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd0f8f-8afa-4eb6-907f-8c1961891648 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.477233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd0f8f-8afa-4eb6-907f-8c1961891648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.506203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-aedd0f8f-8afa-4eb6-907f-8c1961891648 None None] MFA Rules not processed for user `92c9f14ec76d4a28a189eda5aeaaecd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:39.507434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aedd0f8f-8afa-4eb6-907f-8c1961891648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:39.589985 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1096/2192] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:39.601254 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f983d6-e84a-4ca5-9813-d4857c143182 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:39.603003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d8f983d6-e84a-4ca5-9813-d4857c143182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:39.669331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f983d6-e84a-4ca5-9813-d4857c143182 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:39.674253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f46fc-84a8-4cb7-813e-afcda0538553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:39.675106 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f46fc-84a8-4cb7-813e-afcda0538553 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.675404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f46fc-84a8-4cb7-813e-afcda0538553 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.675681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f46fc-84a8-4cb7-813e-afcda0538553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.694180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f46fc-84a8-4cb7-813e-afcda0538553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:39.695638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f46fc-84a8-4cb7-813e-afcda0538553 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:39.697602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd0f8f-8afa-4eb6-907f-8c1961891648 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:39.699685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aedd0f8f-8afa-4eb6-907f-8c1961891648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:39.712402 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1097/2193] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:39.748885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:39.777131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd0f8f-8afa-4eb6-907f-8c1961891648 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:39.781859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:39.782503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.782783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.783075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] PATH_INFO: `/v3/projects/f468feecf59a43bebf46f6f8e3a8f835` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.784344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f468feecf59a43bebf46f6f8e3a8f835)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:39.786299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:39.839222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f468feecf59a43bebf46f6f8e3a8f835', 'request_id': 'req-6bd28655-348f-4989-87c7-21715ea32543'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:39.847106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f468feecf59a43bebf46f6f8e3a8f835', 'request_id': 'req-6bd28655-348f-4989-87c7-21715ea32543'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:39.854927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f468feecf59a43bebf46f6f8e3a8f835', 'request_id': 'req-6bd28655-348f-4989-87c7-21715ea32543'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:39.869788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] The token cache is being invalidate because project f468feecf59a43bebf46f6f8e3a8f835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:39.870242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:39.870932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6bd28655-348f-4989-87c7-21715ea32543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:39.872816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1097/2194] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:39 2022] DELETE /identity/v3/projects/f468feecf59a43bebf46f6f8e3a8f835 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:39.878320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb8a77-c828-4cd6-9a84-dca86f8871a0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.878810 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb8a77-c828-4cd6-9a84-dca86f8871a0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.878892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb8a77-c828-4cd6-9a84-dca86f8871a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:39.899276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5bdb8a77-c828-4cd6-9a84-dca86f8871a0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:39.900519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5bdb8a77-c828-4cd6-9a84-dca86f8871a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:39.934110 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:39.969946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1098/2195] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:39.977922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c75a9-c2e2-4f95-b962-b33c62f6fc93 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:39.978309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c75a9-c2e2-4f95-b962-b33c62f6fc93 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:39.978652 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c75a9-c2e2-4f95-b962-b33c62f6fc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.002873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5c4c75a9-c2e2-4f95-b962-b33c62f6fc93 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:40.004107 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5c4c75a9-c2e2-4f95-b962-b33c62f6fc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:40.016717 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1098/2196] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:40.021380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb8a77-c828-4cd6-9a84-dca86f8871a0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:40.034098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb8a77-c828-4cd6-9a84-dca86f8871a0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:40.038844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15b83-8d7d-4af4-8ca6-b93dd7f9b6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:40.039451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15b83-8d7d-4af4-8ca6-b93dd7f9b6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.041658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15b83-8d7d-4af4-8ca6-b93dd7f9b6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.042030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15b83-8d7d-4af4-8ca6-b93dd7f9b6b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.042590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f15b83-8d7d-4af4-8ca6-b93dd7f9b6b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:40.042961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f15b83-8d7d-4af4-8ca6-b93dd7f9b6b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:40.046656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f15b83-8d7d-4af4-8ca6-b93dd7f9b6b2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:40.068365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1099/2197] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:09:40.072348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c75a9-c2e2-4f95-b962-b33c62f6fc93 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:40.089603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c75a9-c2e2-4f95-b962-b33c62f6fc93 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:40.095507 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe433ca6-9c05-41c7-9606-d4cdc8ea648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:40.096673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe433ca6-9c05-41c7-9606-d4cdc8ea648d admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.097202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe433ca6-9c05-41c7-9606-d4cdc8ea648d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.097858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe433ca6-9c05-41c7-9606-d4cdc8ea648d admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.099161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe433ca6-9c05-41c7-9606-d4cdc8ea648d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:40.101781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe433ca6-9c05-41c7-9606-d4cdc8ea648d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:40.195718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1099/2198] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:40 2022] POST /identity/v3/projects => generated 357 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:40.196998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15b83-8d7d-4af4-8ca6-b93dd7f9b6b2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:40.213217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15b83-8d7d-4af4-8ca6-b93dd7f9b6b2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:40.285615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44e23c-54df-4155-8238-45aab6e6826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:40.286225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44e23c-54df-4155-8238-45aab6e6826f admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.286538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44e23c-54df-4155-8238-45aab6e6826f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.286812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44e23c-54df-4155-8238-45aab6e6826f admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.287487 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44e23c-54df-4155-8238-45aab6e6826f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:40.289474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44e23c-54df-4155-8238-45aab6e6826f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:40.319370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1100/2199] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:40 2022] POST /identity/v3/users => generated 279 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:40.324480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe433ca6-9c05-41c7-9606-d4cdc8ea648d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:40.339022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe433ca6-9c05-41c7-9606-d4cdc8ea648d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:40.344124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14263e-dc55-4ef2-a973-e15da489a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:40.344670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14263e-dc55-4ef2-a973-e15da489a5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.344953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14263e-dc55-4ef2-a973-e15da489a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.345232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14263e-dc55-4ef2-a973-e15da489a5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.346567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14263e-dc55-4ef2-a973-e15da489a5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:40.348184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14263e-dc55-4ef2-a973-e15da489a5c2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:40.359698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1100/2200] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:40.365578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44e23c-54df-4155-8238-45aab6e6826f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:40.379933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44e23c-54df-4155-8238-45aab6e6826f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:40.384972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc5f22-f4ca-47c1-9b0a-1c0e993c5a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:40.385609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5f22-f4ca-47c1-9b0a-1c0e993c5a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.386097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5f22-f4ca-47c1-9b0a-1c0e993c5a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.386217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5f22-f4ca-47c1-9b0a-1c0e993c5a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.386808 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc5f22-f4ca-47c1-9b0a-1c0e993c5a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:40.388604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc5f22-f4ca-47c1-9b0a-1c0e993c5a91 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:40.407245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1101/2201] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:40.411922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14263e-dc55-4ef2-a973-e15da489a5c2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:40.428647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14263e-dc55-4ef2-a973-e15da489a5c2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:40.434965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56956bb2-c388-4171-b73a-ce4e20550837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:40.436196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56956bb2-c388-4171-b73a-ce4e20550837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.436849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56956bb2-c388-4171-b73a-ce4e20550837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.437316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56956bb2-c388-4171-b73a-ce4e20550837 admin admin] PATH_INFO: `/v3/projects/ca02b6b6839a4f5d9c8301af2971d467/users/3883557cc49240c3ac8d29be591ef4a5/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.457012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56956bb2-c388-4171-b73a-ce4e20550837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca02b6b6839a4f5d9c8301af2971d467, user_id=3883557cc49240c3ac8d29be591ef4a5, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:40.460443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56956bb2-c388-4171-b73a-ce4e20550837 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:40.483842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1101/2202] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:40 2022] PUT /identity/v3/projects/ca02b6b6839a4f5d9c8301af2971d467/users/3883557cc49240c3ac8d29be591ef4a5/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:40.498752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a43c0-46ac-401d-b647-0a0c78517b47 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.499053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a43c0-46ac-401d-b647-0a0c78517b47 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.499333 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a43c0-46ac-401d-b647-0a0c78517b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.538784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5e3a43c0-46ac-401d-b647-0a0c78517b47 None None] MFA Rules not processed for user `3883557cc49240c3ac8d29be591ef4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:40.540987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5e3a43c0-46ac-401d-b647-0a0c78517b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:40.631489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1102/2203] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:40.636638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56956bb2-c388-4171-b73a-ce4e20550837 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:40.725850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56956bb2-c388-4171-b73a-ce4e20550837 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:40.733031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3ee7f-8ff2-435b-9d38-13895c03ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:40.733656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ee7f-8ff2-435b-9d38-13895c03ee7a admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.733982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ee7f-8ff2-435b-9d38-13895c03ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.734606 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ee7f-8ff2-435b-9d38-13895c03ee7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.734941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3ee7f-8ff2-435b-9d38-13895c03ee7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:40.737106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3ee7f-8ff2-435b-9d38-13895c03ee7a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:40.744292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:40.788367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1102/2204] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:40 2022] POST /identity/v3/projects => generated 355 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:40.791841 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a43c0-46ac-401d-b647-0a0c78517b47 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:40.803512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a43c0-46ac-401d-b647-0a0c78517b47 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:40.838737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:40.881202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ece98-97f9-4a73-89c5-f582f611d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:40.882212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ece98-97f9-4a73-89c5-f582f611d86e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.882766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ece98-97f9-4a73-89c5-f582f611d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.883014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ece98-97f9-4a73-89c5-f582f611d86e admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.883865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ece98-97f9-4a73-89c5-f582f611d86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:40.886561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ece98-97f9-4a73-89c5-f582f611d86e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:40.916883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1103/2205] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:40 2022] POST /identity/v3/users => generated 284 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:40.921325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3ee7f-8ff2-435b-9d38-13895c03ee7a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:40.932469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3ee7f-8ff2-435b-9d38-13895c03ee7a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:40.937070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105c01b-1478-43cb-94ab-641cafe8cc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:40.937675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c01b-1478-43cb-94ab-641cafe8cc3e admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.937956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c01b-1478-43cb-94ab-641cafe8cc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.938232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c01b-1478-43cb-94ab-641cafe8cc3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.938877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105c01b-1478-43cb-94ab-641cafe8cc3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:40.940624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105c01b-1478-43cb-94ab-641cafe8cc3e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:40.953144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1103/2206] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:40.958645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ece98-97f9-4a73-89c5-f582f611d86e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:40.968743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ece98-97f9-4a73-89c5-f582f611d86e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:40.973985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5676a12-b55e-4a86-90ac-648ccdcb78c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:40.974644 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5676a12-b55e-4a86-90ac-648ccdcb78c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:40.974925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5676a12-b55e-4a86-90ac-648ccdcb78c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:40.975199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5676a12-b55e-4a86-90ac-648ccdcb78c8 admin admin] PATH_INFO: `/v3/projects/7e5e4d4519804defac2870f44a7ab7c6/users/e0ebd5335aea4c3b9d1333a414a06fa2/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:40.991180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5676a12-b55e-4a86-90ac-648ccdcb78c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5e4d4519804defac2870f44a7ab7c6, user_id=e0ebd5335aea4c3b9d1333a414a06fa2, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:40.993893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5676a12-b55e-4a86-90ac-648ccdcb78c8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:41.007796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1104/2207] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:40 2022] PUT /identity/v3/projects/7e5e4d4519804defac2870f44a7ab7c6/users/e0ebd5335aea4c3b9d1333a414a06fa2/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:41.012120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105c01b-1478-43cb-94ab-641cafe8cc3e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:41.022898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105c01b-1478-43cb-94ab-641cafe8cc3e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:41.085865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d030fcb-a76a-4df2-b9dd-340051d5d58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:41.086496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d030fcb-a76a-4df2-b9dd-340051d5d58f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:41.086776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d030fcb-a76a-4df2-b9dd-340051d5d58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:41.087192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d030fcb-a76a-4df2-b9dd-340051d5d58f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:41.087716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d030fcb-a76a-4df2-b9dd-340051d5d58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:41.089440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d030fcb-a76a-4df2-b9dd-340051d5d58f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:41.104176 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1104/2208] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:41.105160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5676a12-b55e-4a86-90ac-648ccdcb78c8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:41.119169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5676a12-b55e-4a86-90ac-648ccdcb78c8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:41.129713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41325341-6b85-43d0-912a-bf69d90f4fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:41.129713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41325341-6b85-43d0-912a-bf69d90f4fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:41.129713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41325341-6b85-43d0-912a-bf69d90f4fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:41.129713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41325341-6b85-43d0-912a-bf69d90f4fc1 admin admin] PATH_INFO: `/v3/projects/7e5e4d4519804defac2870f44a7ab7c6/users/e0ebd5335aea4c3b9d1333a414a06fa2/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:41.130096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41325341-6b85-43d0-912a-bf69d90f4fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5e4d4519804defac2870f44a7ab7c6, user_id=e0ebd5335aea4c3b9d1333a414a06fa2, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:41.131791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41325341-6b85-43d0-912a-bf69d90f4fc1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:41.148381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1105/2209] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:41 2022] PUT /identity/v3/projects/7e5e4d4519804defac2870f44a7ab7c6/users/e0ebd5335aea4c3b9d1333a414a06fa2/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:41.155675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3b52-f1a1-4aa4-a4c7-86414c683c04 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:41.155974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3b52-f1a1-4aa4-a4c7-86414c683c04 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:41.156261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3b52-f1a1-4aa4-a4c7-86414c683c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:41.190834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-14cd3b52-f1a1-4aa4-a4c7-86414c683c04 None None] MFA Rules not processed for user `e0ebd5335aea4c3b9d1333a414a06fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:41.192151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-14cd3b52-f1a1-4aa4-a4c7-86414c683c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:41.284045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1105/2210] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:41.296660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41325341-6b85-43d0-912a-bf69d90f4fc1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:41.299558 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-41325341-6b85-43d0-912a-bf69d90f4fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:41.398029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41325341-6b85-43d0-912a-bf69d90f4fc1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:41.402221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9293dd-68d8-47c2-9fd4-142420c5f04f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:41.402993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9293dd-68d8-47c2-9fd4-142420c5f04f service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:41.403285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9293dd-68d8-47c2-9fd4-142420c5f04f service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:41.403561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9293dd-68d8-47c2-9fd4-142420c5f04f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:41.416172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9293dd-68d8-47c2-9fd4-142420c5f04f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:41.417832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9293dd-68d8-47c2-9fd4-142420c5f04f service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:41.429784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1106/2211] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:41.518272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd3b52-f1a1-4aa4-a4c7-86414c683c04 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:41.539684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd3b52-f1a1-4aa4-a4c7-86414c683c04 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:41.544208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770154da-ba0d-45ac-bd8c-982f8a51f6ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:41.544928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770154da-ba0d-45ac-bd8c-982f8a51f6ee service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:41.545285 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770154da-ba0d-45ac-bd8c-982f8a51f6ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:41.545631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770154da-ba0d-45ac-bd8c-982f8a51f6ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:41.648106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:41.651160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770154da-ba0d-45ac-bd8c-982f8a51f6ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:41.653648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770154da-ba0d-45ac-bd8c-982f8a51f6ee service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:41.674456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1106/2212] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:45.981175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9293dd-68d8-47c2-9fd4-142420c5f04f service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:45.982670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0b9293dd-68d8-47c2-9fd4-142420c5f04f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:46.078741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9293dd-68d8-47c2-9fd4-142420c5f04f service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:46.084216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:46.084896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:46.085580 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:46.085884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] PATH_INFO: `/v3/users/e8ffe46cb97c4a088d0c2638289289b0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:46.088702 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ffe46cb97c4a088d0c2638289289b0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:46.091442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:46.132541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:46.165482 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ffe46cb97c4a088d0c2638289289b0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:46.166846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ffe46cb97c4a088d0c2638289289b0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:46.177894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ffe46cb97c4a088d0c2638289289b0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:46.197664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ffe46cb97c4a088d0c2638289289b0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:46.207883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ffe46cb97c4a088d0c2638289289b0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:46.215376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1107/2213] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:45 2022] DELETE /identity/v3/users/e8ffe46cb97c4a088d0c2638289289b0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:46.221278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672712-01ba-413d-93ec-3afefc9db5ee None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:46.221278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672712-01ba-413d-93ec-3afefc9db5ee None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:46.222019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672712-01ba-413d-93ec-3afefc9db5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:46.246716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8c672712-01ba-413d-93ec-3afefc9db5ee None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:46.248026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8c672712-01ba-413d-93ec-3afefc9db5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:46.325932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1107/2214] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:46.350646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:46.353241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:46.445619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50bf4f-c28c-40de-ab35-4a6efb40b402 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:46.451477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232b4c5-ed38-47e9-95f5-634bd4deeda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:46.452192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b4c5-ed38-47e9-95f5-634bd4deeda0 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:46.452560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b4c5-ed38-47e9-95f5-634bd4deeda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:46.452779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b4c5-ed38-47e9-95f5-634bd4deeda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:46.475325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232b4c5-ed38-47e9-95f5-634bd4deeda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:46.476823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232b4c5-ed38-47e9-95f5-634bd4deeda0 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:46.491018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1108/2215] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:46.864145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672712-01ba-413d-93ec-3afefc9db5ee None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:46.869706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8c672712-01ba-413d-93ec-3afefc9db5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:46.890344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672712-01ba-413d-93ec-3afefc9db5ee None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:46.898718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:46.899370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:46.899761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:46.900125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] PATH_INFO: `/v3/projects/24f22115e2c44624ad0a80d790e6d282` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:46.901872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f22115e2c44624ad0a80d790e6d282)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:46.903879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:46.962702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f22115e2c44624ad0a80d790e6d282', 'request_id': 'req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:46.968316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f22115e2c44624ad0a80d790e6d282', 'request_id': 'req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:46.976080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f22115e2c44624ad0a80d790e6d282', 'request_id': 'req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:46.989430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] The token cache is being invalidate because project 24f22115e2c44624ad0a80d790e6d282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:46.989722 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:46.990348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d1b612c6-a6ea-4e10-97ed-4f04d8405c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:46.991826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1108/2216] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:46 2022] DELETE /identity/v3/projects/24f22115e2c44624ad0a80d790e6d282 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:46.996910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b050-af30-4ca1-9a3a-4920c24252b0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:46.997368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b050-af30-4ca1-9a3a-4920c24252b0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:46.997479 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b050-af30-4ca1-9a3a-4920c24252b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.018469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-63c2b050-af30-4ca1-9a3a-4920c24252b0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:47.020199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-63c2b050-af30-4ca1-9a3a-4920c24252b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:47.092742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1109/2217] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:47.095970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc2a1f-6f68-48b5-93fe-8afe7b42b119 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.096299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc2a1f-6f68-48b5-93fe-8afe7b42b119 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.096616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc2a1f-6f68-48b5-93fe-8afe7b42b119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.118794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-effc2a1f-6f68-48b5-93fe-8afe7b42b119 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:47.120077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-effc2a1f-6f68-48b5-93fe-8afe7b42b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:47.137321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1109/2218] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:47.138598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2b050-af30-4ca1-9a3a-4920c24252b0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.163543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2b050-af30-4ca1-9a3a-4920c24252b0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.168546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820582a0-43ae-473f-bb25-5c0d71a3b94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.169155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820582a0-43ae-473f-bb25-5c0d71a3b94d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.169439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820582a0-43ae-473f-bb25-5c0d71a3b94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.169715 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820582a0-43ae-473f-bb25-5c0d71a3b94d admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.170370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820582a0-43ae-473f-bb25-5c0d71a3b94d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:47.170677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820582a0-43ae-473f-bb25-5c0d71a3b94d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.172272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820582a0-43ae-473f-bb25-5c0d71a3b94d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:47.184666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1110/2219] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:09:47.189321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc2a1f-6f68-48b5-93fe-8afe7b42b119 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.200934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc2a1f-6f68-48b5-93fe-8afe7b42b119 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.206155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70412c-cf47-4e67-b5b2-f6fac8d0828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.206775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70412c-cf47-4e67-b5b2-f6fac8d0828d admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.207329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70412c-cf47-4e67-b5b2-f6fac8d0828d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.207627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70412c-cf47-4e67-b5b2-f6fac8d0828d admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.208273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70412c-cf47-4e67-b5b2-f6fac8d0828d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.210219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70412c-cf47-4e67-b5b2-f6fac8d0828d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:47.238742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1110/2220] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:47 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:47.242872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820582a0-43ae-473f-bb25-5c0d71a3b94d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.252883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820582a0-43ae-473f-bb25-5c0d71a3b94d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.285348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:47.312028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d8395-e954-47c4-b68a-396c37dc38f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.312670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d8395-e954-47c4-b68a-396c37dc38f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.312955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d8395-e954-47c4-b68a-396c37dc38f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.313232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d8395-e954-47c4-b68a-396c37dc38f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.313864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d8395-e954-47c4-b68a-396c37dc38f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.315788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d8395-e954-47c4-b68a-396c37dc38f1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:47.340242 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1111/2221] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:47 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:47.344209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70412c-cf47-4e67-b5b2-f6fac8d0828d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.356912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70412c-cf47-4e67-b5b2-f6fac8d0828d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.362723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72228ab2-731c-4e8c-be96-4514fd694f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.364050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72228ab2-731c-4e8c-be96-4514fd694f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.364361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72228ab2-731c-4e8c-be96-4514fd694f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.364702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72228ab2-731c-4e8c-be96-4514fd694f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.365400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72228ab2-731c-4e8c-be96-4514fd694f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.367337 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72228ab2-731c-4e8c-be96-4514fd694f65 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:47.386947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1111/2222] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:47.390773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d8395-e954-47c4-b68a-396c37dc38f1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.404160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d8395-e954-47c4-b68a-396c37dc38f1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.409146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42458663-1272-4216-ae44-46b6b14ba70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.409968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42458663-1272-4216-ae44-46b6b14ba70d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.410329 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42458663-1272-4216-ae44-46b6b14ba70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.411193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42458663-1272-4216-ae44-46b6b14ba70d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.411846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42458663-1272-4216-ae44-46b6b14ba70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.413476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42458663-1272-4216-ae44-46b6b14ba70d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:47.430430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1112/2223] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:47.431598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72228ab2-731c-4e8c-be96-4514fd694f65 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.442391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72228ab2-731c-4e8c-be96-4514fd694f65 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.447162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d88ef0-f57e-4a94-a0c6-4fce13291995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.447798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d88ef0-f57e-4a94-a0c6-4fce13291995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.448106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d88ef0-f57e-4a94-a0c6-4fce13291995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.448420 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d88ef0-f57e-4a94-a0c6-4fce13291995 admin admin] PATH_INFO: `/v3/projects/bf55ed32ae82446590662d1254793717/users/39f617582eef4ea89ea63cada9465a28/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.464587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d88ef0-f57e-4a94-a0c6-4fce13291995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf55ed32ae82446590662d1254793717, user_id=39f617582eef4ea89ea63cada9465a28, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.467712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d88ef0-f57e-4a94-a0c6-4fce13291995 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:47.484225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1112/2224] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:47 2022] PUT /identity/v3/projects/bf55ed32ae82446590662d1254793717/users/39f617582eef4ea89ea63cada9465a28/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:47.495274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e8c8b-ba8f-4533-8a8e-a83d25de0c35 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.495564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e8c8b-ba8f-4533-8a8e-a83d25de0c35 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.495837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e8c8b-ba8f-4533-8a8e-a83d25de0c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.531637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e05e8c8b-ba8f-4533-8a8e-a83d25de0c35 None None] MFA Rules not processed for user `39f617582eef4ea89ea63cada9465a28`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:47.532876 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e05e8c8b-ba8f-4533-8a8e-a83d25de0c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:47.601154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1113/2225] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:47.605737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d88ef0-f57e-4a94-a0c6-4fce13291995 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.623873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:47.674776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d88ef0-f57e-4a94-a0c6-4fce13291995 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.680664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919ab2a-634e-4e9e-b4c0-67f32574f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.681271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919ab2a-634e-4e9e-b4c0-67f32574f8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.681555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919ab2a-634e-4e9e-b4c0-67f32574f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.681838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919ab2a-634e-4e9e-b4c0-67f32574f8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.682476 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919ab2a-634e-4e9e-b4c0-67f32574f8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.684427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919ab2a-634e-4e9e-b4c0-67f32574f8d3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:47.722905 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1113/2226] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:47 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:47.724609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e8c8b-ba8f-4533-8a8e-a83d25de0c35 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.735176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e8c8b-ba8f-4533-8a8e-a83d25de0c35 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.812286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea259a-c9b3-4142-a6e7-c4390a68efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.813063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea259a-c9b3-4142-a6e7-c4390a68efaa admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.813449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea259a-c9b3-4142-a6e7-c4390a68efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.813834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea259a-c9b3-4142-a6e7-c4390a68efaa admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.814667 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea259a-c9b3-4142-a6e7-c4390a68efaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.817607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea259a-c9b3-4142-a6e7-c4390a68efaa admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:47.845051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1114/2227] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:47 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:47.855781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919ab2a-634e-4e9e-b4c0-67f32574f8d3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.867633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919ab2a-634e-4e9e-b4c0-67f32574f8d3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.873068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d7b49-2868-42cf-96d3-085957a1903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.873822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d7b49-2868-42cf-96d3-085957a1903e admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.874182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d7b49-2868-42cf-96d3-085957a1903e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.874502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d7b49-2868-42cf-96d3-085957a1903e admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.875173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d7b49-2868-42cf-96d3-085957a1903e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.877002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d7b49-2868-42cf-96d3-085957a1903e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:47.889235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1114/2228] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:47.893320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea259a-c9b3-4142-a6e7-c4390a68efaa admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.904398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea259a-c9b3-4142-a6e7-c4390a68efaa admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.909171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d708b-9237-4121-8c74-767c5963c7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.910455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d708b-9237-4121-8c74-767c5963c7ef admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.910794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d708b-9237-4121-8c74-767c5963c7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.911071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d708b-9237-4121-8c74-767c5963c7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.911716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d708b-9237-4121-8c74-767c5963c7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.913343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d708b-9237-4121-8c74-767c5963c7ef admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:47.923932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1115/2229] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:47.929090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d7b49-2868-42cf-96d3-085957a1903e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:47.946021 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d7b49-2868-42cf-96d3-085957a1903e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:47.952195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d0e4-1150-4c74-9ade-8c40d3ab9aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:47.955984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d0e4-1150-4c74-9ade-8c40d3ab9aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:47.957029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d0e4-1150-4c74-9ade-8c40d3ab9aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:47.957534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d0e4-1150-4c74-9ade-8c40d3ab9aa7 admin admin] PATH_INFO: `/v3/projects/71ceebe2bd3647ee98340d6d4421e0e7/users/63740e3df1234e939c5d9c316ceca142/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:47.986731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514d0e4-1150-4c74-9ade-8c40d3ab9aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ceebe2bd3647ee98340d6d4421e0e7, user_id=63740e3df1234e939c5d9c316ceca142, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:47.992600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514d0e4-1150-4c74-9ade-8c40d3ab9aa7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:48.014516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1115/2230] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:47 2022] PUT /identity/v3/projects/71ceebe2bd3647ee98340d6d4421e0e7/users/63740e3df1234e939c5d9c316ceca142/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:48.026370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb3a0f-14eb-40fe-b07e-7895566e6b8f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:48.026874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb3a0f-14eb-40fe-b07e-7895566e6b8f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:48.026874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb3a0f-14eb-40fe-b07e-7895566e6b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:48.063323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-eafb3a0f-14eb-40fe-b07e-7895566e6b8f None None] MFA Rules not processed for user `63740e3df1234e939c5d9c316ceca142`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:48.065448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eafb3a0f-14eb-40fe-b07e-7895566e6b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:48.080372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:48.166859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1116/2231] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:48.171828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d0e4-1150-4c74-9ade-8c40d3ab9aa7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:48.240695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d0e4-1150-4c74-9ade-8c40d3ab9aa7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:48.245484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6db401-b9ce-461d-85c2-debaaee92be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:48.246090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6db401-b9ce-461d-85c2-debaaee92be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:48.246377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6db401-b9ce-461d-85c2-debaaee92be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:48.246654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6db401-b9ce-461d-85c2-debaaee92be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:48.247290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6db401-b9ce-461d-85c2-debaaee92be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:48.249236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6db401-b9ce-461d-85c2-debaaee92be1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:48.277416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1116/2232] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:48 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:48.281596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb3a0f-14eb-40fe-b07e-7895566e6b8f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:48.292688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb3a0f-14eb-40fe-b07e-7895566e6b8f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:48.351301 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e955b-4acf-40af-8730-3736ed163774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:48.351930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e955b-4acf-40af-8730-3736ed163774 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:48.352251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e955b-4acf-40af-8730-3736ed163774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:48.352562 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e955b-4acf-40af-8730-3736ed163774 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:48.353206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e955b-4acf-40af-8730-3736ed163774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:48.355127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e955b-4acf-40af-8730-3736ed163774 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:48.375915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1117/2233] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:48 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:48.380010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6db401-b9ce-461d-85c2-debaaee92be1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:48.390903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6db401-b9ce-461d-85c2-debaaee92be1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:48.396478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f849aa-3bc7-4993-9171-dff5c9bd5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:48.397083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f849aa-3bc7-4993-9171-dff5c9bd5045 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:48.397366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f849aa-3bc7-4993-9171-dff5c9bd5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:48.397642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f849aa-3bc7-4993-9171-dff5c9bd5045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:48.398283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f849aa-3bc7-4993-9171-dff5c9bd5045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:48.399866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f849aa-3bc7-4993-9171-dff5c9bd5045 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:48.410999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1117/2234] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:48.415190 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e955b-4acf-40af-8730-3736ed163774 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:48.428259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e955b-4acf-40af-8730-3736ed163774 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:48.432915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d759-74e4-445d-aa35-ba353c154637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:48.433563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d759-74e4-445d-aa35-ba353c154637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:48.433843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d759-74e4-445d-aa35-ba353c154637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:48.434118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d759-74e4-445d-aa35-ba353c154637 admin admin] PATH_INFO: `/v3/projects/112e4ccbf0044848a08967012c791a14/users/9a2ce3bee43f4b488160705fe24b7703/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:48.451505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d759-74e4-445d-aa35-ba353c154637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112e4ccbf0044848a08967012c791a14, user_id=9a2ce3bee43f4b488160705fe24b7703, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:48.454686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d759-74e4-445d-aa35-ba353c154637 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:48.470315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1118/2235] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:48 2022] PUT /identity/v3/projects/112e4ccbf0044848a08967012c791a14/users/9a2ce3bee43f4b488160705fe24b7703/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:48.475316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f849aa-3bc7-4993-9171-dff5c9bd5045 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:48.485289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f849aa-3bc7-4993-9171-dff5c9bd5045 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:48.527936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:48.561851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce3f9f-3281-461f-a825-957b0f326090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:48.562611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce3f9f-3281-461f-a825-957b0f326090 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:48.562909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce3f9f-3281-461f-a825-957b0f326090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:48.563219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce3f9f-3281-461f-a825-957b0f326090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:48.564411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce3f9f-3281-461f-a825-957b0f326090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:48.566242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce3f9f-3281-461f-a825-957b0f326090 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:48.579808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1118/2236] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:48.584769 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d759-74e4-445d-aa35-ba353c154637 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:48.596798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d759-74e4-445d-aa35-ba353c154637 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:48.602811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aadfb9-d967-496f-a566-7519813d04bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:48.603322 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aadfb9-d967-496f-a566-7519813d04bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:48.603677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aadfb9-d967-496f-a566-7519813d04bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:48.603964 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aadfb9-d967-496f-a566-7519813d04bb admin admin] PATH_INFO: `/v3/projects/112e4ccbf0044848a08967012c791a14/users/9a2ce3bee43f4b488160705fe24b7703/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:48.606044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aadfb9-d967-496f-a566-7519813d04bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=112e4ccbf0044848a08967012c791a14, user_id=9a2ce3bee43f4b488160705fe24b7703, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:48.608793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aadfb9-d967-496f-a566-7519813d04bb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:48.620120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1119/2237] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:48 2022] PUT /identity/v3/projects/112e4ccbf0044848a08967012c791a14/users/9a2ce3bee43f4b488160705fe24b7703/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:48.632187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462060e-af8b-4323-b2e9-862ac617ce39 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:48.632491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462060e-af8b-4323-b2e9-862ac617ce39 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:48.632742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462060e-af8b-4323-b2e9-862ac617ce39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:48.664406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4462060e-af8b-4323-b2e9-862ac617ce39 None None] MFA Rules not processed for user `9a2ce3bee43f4b488160705fe24b7703`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:48.665644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4462060e-af8b-4323-b2e9-862ac617ce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:48.762841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1119/2238] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:09:48.774723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aadfb9-d967-496f-a566-7519813d04bb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:48.776631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e6aadfb9-d967-496f-a566-7519813d04bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:48.845891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aadfb9-d967-496f-a566-7519813d04bb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:48.850756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffe0ff-a88d-4442-aeaa-425765630566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:48.851388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffe0ff-a88d-4442-aeaa-425765630566 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:48.851670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffe0ff-a88d-4442-aeaa-425765630566 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:48.851945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffe0ff-a88d-4442-aeaa-425765630566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:48.871754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:48.929019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffe0ff-a88d-4442-aeaa-425765630566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:48.930814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffe0ff-a88d-4442-aeaa-425765630566 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:48.954255 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1120/2239] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:50.527455 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462060e-af8b-4323-b2e9-862ac617ce39 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:50.529625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4462060e-af8b-4323-b2e9-862ac617ce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:50.669005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462060e-af8b-4323-b2e9-862ac617ce39 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:50.687535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:50.688395 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:50.688674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:50.689005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] PATH_INFO: `/v3/users/92c9f14ec76d4a28a189eda5aeaaecd9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:50.690461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c9f14ec76d4a28a189eda5aeaaecd9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:50.692842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:50.753757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffe0ff-a88d-4442-aeaa-425765630566 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:50.767780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffe0ff-a88d-4442-aeaa-425765630566 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:50.774313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c9f14ec76d4a28a189eda5aeaaecd9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:50.775035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c9f14ec76d4a28a189eda5aeaaecd9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:50.775809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562451e-54d0-4b14-9c07-c43a68aac5be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:50.776638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562451e-54d0-4b14-9c07-c43a68aac5be service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:50.777025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562451e-54d0-4b14-9c07-c43a68aac5be service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:50.777394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562451e-54d0-4b14-9c07-c43a68aac5be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:50.779297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e562451e-54d0-4b14-9c07-c43a68aac5be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:50.786728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c9f14ec76d4a28a189eda5aeaaecd9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:50.795002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c9f14ec76d4a28a189eda5aeaaecd9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:50.796808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:50.826207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e5004e2d-3981-4384-bd25-dccf47974622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c9f14ec76d4a28a189eda5aeaaecd9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:50.838554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1120/2240] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:50 2022] DELETE /identity/v3/users/92c9f14ec76d4a28a189eda5aeaaecd9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:50.845101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75198c7a-f4de-4227-bd6c-cb3bfee2f899 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:50.845512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75198c7a-f4de-4227-bd6c-cb3bfee2f899 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:50.845684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75198c7a-f4de-4227-bd6c-cb3bfee2f899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:50.867502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-75198c7a-f4de-4227-bd6c-cb3bfee2f899 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:50.869078 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-75198c7a-f4de-4227-bd6c-cb3bfee2f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:50.881644 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562451e-54d0-4b14-9c07-c43a68aac5be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:50.884374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562451e-54d0-4b14-9c07-c43a68aac5be service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:50.897437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1121/2241] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:50.993253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1121/2242] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:51.005344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562451e-54d0-4b14-9c07-c43a68aac5be service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:51.007601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e562451e-54d0-4b14-9c07-c43a68aac5be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:51.078101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562451e-54d0-4b14-9c07-c43a68aac5be service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:51.136879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32870ac7-7e1d-46b4-9a1b-43820a8c0073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:51.137718 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32870ac7-7e1d-46b4-9a1b-43820a8c0073 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:51.138079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32870ac7-7e1d-46b4-9a1b-43820a8c0073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:51.138787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32870ac7-7e1d-46b4-9a1b-43820a8c0073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:51.155380 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32870ac7-7e1d-46b4-9a1b-43820a8c0073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:51.157253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32870ac7-7e1d-46b4-9a1b-43820a8c0073 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:51.170018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1122/2243] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:51.490302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75198c7a-f4de-4227-bd6c-cb3bfee2f899 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:51.491870 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-75198c7a-f4de-4227-bd6c-cb3bfee2f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:51.520826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75198c7a-f4de-4227-bd6c-cb3bfee2f899 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:51.520826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:51.520826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:51.520826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:51.521551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] PATH_INFO: `/v3/projects/db7a23e98b1142e79a37dd55738fad8d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:51.521551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7a23e98b1142e79a37dd55738fad8d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:51.522379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:51.589384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7a23e98b1142e79a37dd55738fad8d', 'request_id': 'req-22d024c7-e556-487f-9aa7-039d6fcb3ca3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:51.611513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7a23e98b1142e79a37dd55738fad8d', 'request_id': 'req-22d024c7-e556-487f-9aa7-039d6fcb3ca3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:51.618040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7a23e98b1142e79a37dd55738fad8d', 'request_id': 'req-22d024c7-e556-487f-9aa7-039d6fcb3ca3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:51.619977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32870ac7-7e1d-46b4-9a1b-43820a8c0073 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:51.622827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-32870ac7-7e1d-46b4-9a1b-43820a8c0073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:51.637457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] The token cache is being invalidate because project db7a23e98b1142e79a37dd55738fad8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:51.637758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:51.638638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d024c7-e556-487f-9aa7-039d6fcb3ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:51.640564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1122/2244] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:51 2022] DELETE /identity/v3/projects/db7a23e98b1142e79a37dd55738fad8d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:51.645276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:51.646440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a24cd-4868-43e8-a5b1-eedaea6d6d07 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:51.647086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a24cd-4868-43e8-a5b1-eedaea6d6d07 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:51.647317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a24cd-4868-43e8-a5b1-eedaea6d6d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:51.670434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4b1a24cd-4868-43e8-a5b1-eedaea6d6d07 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:51.671821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4b1a24cd-4868-43e8-a5b1-eedaea6d6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:51.696939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32870ac7-7e1d-46b4-9a1b-43820a8c0073 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:51.746620 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1123/2245] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:51.755151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f61dda-fcd8-4fd3-a0bf-e0858f0600d0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:51.755450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f61dda-fcd8-4fd3-a0bf-e0858f0600d0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:51.755740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f61dda-fcd8-4fd3-a0bf-e0858f0600d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:51.758049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b69ae6-7565-4d41-9e23-d39f93f6c143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:51.758760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69ae6-7565-4d41-9e23-d39f93f6c143 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:51.759110 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69ae6-7565-4d41-9e23-d39f93f6c143 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:51.759585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69ae6-7565-4d41-9e23-d39f93f6c143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:51.761451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-82b69ae6-7565-4d41-9e23-d39f93f6c143 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:51.766427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:51.780873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-61f61dda-fcd8-4fd3-a0bf-e0858f0600d0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:51.782790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-61f61dda-fcd8-4fd3-a0bf-e0858f0600d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:51.797064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1124/2246] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:51.801438 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f61dda-fcd8-4fd3-a0bf-e0858f0600d0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:51.810940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f61dda-fcd8-4fd3-a0bf-e0858f0600d0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:51.816890 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69584186-0b78-44e0-8406-0b4a14421ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:51.817616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69584186-0b78-44e0-8406-0b4a14421ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:51.817973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69584186-0b78-44e0-8406-0b4a14421ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:51.818325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69584186-0b78-44e0-8406-0b4a14421ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:51.819052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69584186-0b78-44e0-8406-0b4a14421ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:09:51.819442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69584186-0b78-44e0-8406-0b4a14421ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:51.821188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69584186-0b78-44e0-8406-0b4a14421ed6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:51.837296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1125/2247] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:09:51.841856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69584186-0b78-44e0-8406-0b4a14421ed6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:51.844835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b69ae6-7565-4d41-9e23-d39f93f6c143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:51.846376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b69ae6-7565-4d41-9e23-d39f93f6c143 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:51.852736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69584186-0b78-44e0-8406-0b4a14421ed6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:51.857483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1123/2248] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:09:51.859015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbd2c7-7d19-4534-840b-2e9815893b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:51.859746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd2c7-7d19-4534-840b-2e9815893b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:51.860042 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd2c7-7d19-4534-840b-2e9815893b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:51.860338 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd2c7-7d19-4534-840b-2e9815893b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:51.860992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbd2c7-7d19-4534-840b-2e9815893b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:51.863712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbd2c7-7d19-4534-840b-2e9815893b25 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:51.915664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1126/2249] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:51 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:09:51.920085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b69ae6-7565-4d41-9e23-d39f93f6c143 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:51.946754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b69ae6-7565-4d41-9e23-d39f93f6c143 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:52.080622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5e419-b2e7-4a32-91e0-6a52e43e04fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:52.081260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e419-b2e7-4a32-91e0-6a52e43e04fb admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:52.081589 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e419-b2e7-4a32-91e0-6a52e43e04fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:52.082736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e419-b2e7-4a32-91e0-6a52e43e04fb admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:52.083414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5e419-b2e7-4a32-91e0-6a52e43e04fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:52.086062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5e419-b2e7-4a32-91e0-6a52e43e04fb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:52.118047 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1124/2250] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:51 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:52.118281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbd2c7-7d19-4534-840b-2e9815893b25 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:52.130834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbd2c7-7d19-4534-840b-2e9815893b25 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:52.136002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee58e1-b5b4-4dc9-a935-36007d017c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:52.136646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee58e1-b5b4-4dc9-a935-36007d017c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:52.136892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee58e1-b5b4-4dc9-a935-36007d017c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:52.137173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee58e1-b5b4-4dc9-a935-36007d017c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:52.137920 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee58e1-b5b4-4dc9-a935-36007d017c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:52.139555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee58e1-b5b4-4dc9-a935-36007d017c2f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:52.161027 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1127/2251] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:09:52.164669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5e419-b2e7-4a32-91e0-6a52e43e04fb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:52.177742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5e419-b2e7-4a32-91e0-6a52e43e04fb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:52.190590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99ad35-2ef7-4157-aa4f-84584f882906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:52.192089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99ad35-2ef7-4157-aa4f-84584f882906 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:52.192607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99ad35-2ef7-4157-aa4f-84584f882906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:52.192783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99ad35-2ef7-4157-aa4f-84584f882906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:52.193291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99ad35-2ef7-4157-aa4f-84584f882906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:52.194894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99ad35-2ef7-4157-aa4f-84584f882906 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:52.200993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:52.210905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1125/2252] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:52.212253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee58e1-b5b4-4dc9-a935-36007d017c2f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:52.223344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee58e1-b5b4-4dc9-a935-36007d017c2f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:52.228928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752eeee1-d351-4ecd-91b6-efc9025a26df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:52.229789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752eeee1-d351-4ecd-91b6-efc9025a26df admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:52.230077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752eeee1-d351-4ecd-91b6-efc9025a26df admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:52.230368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752eeee1-d351-4ecd-91b6-efc9025a26df admin admin] PATH_INFO: `/v3/projects/948dbd12a6e148e4ba7d6d71dc6bb780/users/94de55a6079d433284ae27c837dad550/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:52.248989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752eeee1-d351-4ecd-91b6-efc9025a26df admin admin] RBAC: Authorizing `identity:create_grant(project_id=948dbd12a6e148e4ba7d6d71dc6bb780, user_id=94de55a6079d433284ae27c837dad550, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:52.251741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752eeee1-d351-4ecd-91b6-efc9025a26df admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:52.267530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1128/2253] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:52 2022] PUT /identity/v3/projects/948dbd12a6e148e4ba7d6d71dc6bb780/users/94de55a6079d433284ae27c837dad550/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:52.272656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2e983-6c76-406f-bc19-96bd6fe5b228 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:52.272952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2e983-6c76-406f-bc19-96bd6fe5b228 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:52.273232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2e983-6c76-406f-bc19-96bd6fe5b228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:52.298011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f9b2e983-6c76-406f-bc19-96bd6fe5b228 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:52.299325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f9b2e983-6c76-406f-bc19-96bd6fe5b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:52.374780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1126/2254] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:52.385316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752eeee1-d351-4ecd-91b6-efc9025a26df admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:52.387079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-752eeee1-d351-4ecd-91b6-efc9025a26df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:52.447823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752eeee1-d351-4ecd-91b6-efc9025a26df admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:52.451933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0561-7cf7-4c5f-80b4-690194ae1bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:52.452509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0561-7cf7-4c5f-80b4-690194ae1bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:52.452789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0561-7cf7-4c5f-80b4-690194ae1bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:52.453061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0561-7cf7-4c5f-80b4-690194ae1bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:52.464179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0561-7cf7-4c5f-80b4-690194ae1bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:52.465710 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0561-7cf7-4c5f-80b4-690194ae1bf2 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:52.477771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1129/2255] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:56.342202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2e983-6c76-406f-bc19-96bd6fe5b228 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:56.343853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f9b2e983-6c76-406f-bc19-96bd6fe5b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:56.357716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2e983-6c76-406f-bc19-96bd6fe5b228 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:56.363290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:56.363985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:56.364252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:56.364566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] PATH_INFO: `/v3/users/39f617582eef4ea89ea63cada9465a28` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:56.365910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f617582eef4ea89ea63cada9465a28)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:56.367874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:56.449590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f617582eef4ea89ea63cada9465a28'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:56.450530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f617582eef4ea89ea63cada9465a28'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:56.467168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f617582eef4ea89ea63cada9465a28'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:56.499310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f617582eef4ea89ea63cada9465a28'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:56.512361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f617582eef4ea89ea63cada9465a28'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:56.523093 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1127/2256] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:56 2022] DELETE /identity/v3/users/39f617582eef4ea89ea63cada9465a28 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:56.534725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecc405-5840-4fab-a66f-7c036c6e7ff4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:56.535278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecc405-5840-4fab-a66f-7c036c6e7ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:56.535364 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecc405-5840-4fab-a66f-7c036c6e7ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:56.589839 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8eecc405-5840-4fab-a66f-7c036c6e7ff4 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:56.592154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8eecc405-5840-4fab-a66f-7c036c6e7ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:56.674744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1130/2257] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:56.688029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:56.690067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:56.762502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195a07-4b80-4471-bfe9-5ae0c5ef6960 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:56.767217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0863f-fef3-4eb2-b9aa-dd7a112b3db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:56.767915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0863f-fef3-4eb2-b9aa-dd7a112b3db0 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:56.768196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0863f-fef3-4eb2-b9aa-dd7a112b3db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:56.768530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0863f-fef3-4eb2-b9aa-dd7a112b3db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:56.783203 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0863f-fef3-4eb2-b9aa-dd7a112b3db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:56.785450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0863f-fef3-4eb2-b9aa-dd7a112b3db0 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:56.803882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1128/2258] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:57.140102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecc405-5840-4fab-a66f-7c036c6e7ff4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:57.142132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8eecc405-5840-4fab-a66f-7c036c6e7ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:57.176123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecc405-5840-4fab-a66f-7c036c6e7ff4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:57.181423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:57.182108 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:57.182396 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:57.182681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] PATH_INFO: `/v3/projects/bf55ed32ae82446590662d1254793717` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:57.183843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf55ed32ae82446590662d1254793717)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:57.185946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:57.244713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:57.291538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf55ed32ae82446590662d1254793717', 'request_id': 'req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:57.303720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf55ed32ae82446590662d1254793717', 'request_id': 'req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:57.312374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf55ed32ae82446590662d1254793717', 'request_id': 'req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:57.335721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] The token cache is being invalidate because project bf55ed32ae82446590662d1254793717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:57.336447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:57.337334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:57.339807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1131/2259] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:57 2022] DELETE /identity/v3/projects/bf55ed32ae82446590662d1254793717 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:57.344306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0863f-fef3-4eb2-b9aa-dd7a112b3db0 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:57.358057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0863f-fef3-4eb2-b9aa-dd7a112b3db0 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:57.381060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:57.465861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:57.468743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:57.470406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:57.470406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] PATH_INFO: `/v3/users/63740e3df1234e939c5d9c316ceca142` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:57.473514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63740e3df1234e939c5d9c316ceca142)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:57.475492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:57.602737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63740e3df1234e939c5d9c316ceca142'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:57.605319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63740e3df1234e939c5d9c316ceca142'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:57.634567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63740e3df1234e939c5d9c316ceca142'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:57.660089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63740e3df1234e939c5d9c316ceca142'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:57.669394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63740e3df1234e939c5d9c316ceca142'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:57.684100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1129/2260] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:57 2022] DELETE /identity/v3/users/63740e3df1234e939c5d9c316ceca142 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:57.965860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:57.967708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:57.982737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ca478-75ee-4a04-8c53-5a3e8f55d2c8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:58.088233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:58.089333 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:58.110240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:58.111608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:58.111608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:58.111608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] PATH_INFO: `/v3/users/3883557cc49240c3ac8d29be591ef4a5` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:58.113247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3883557cc49240c3ac8d29be591ef4a5)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:58.115880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:58.205665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3883557cc49240c3ac8d29be591ef4a5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.206292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3883557cc49240c3ac8d29be591ef4a5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.221597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3883557cc49240c3ac8d29be591ef4a5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.234359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3883557cc49240c3ac8d29be591ef4a5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.261566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-faec1a03-e27e-432c-905f-5a802144a149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3883557cc49240c3ac8d29be591ef4a5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.275986 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1132/2261] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:57 2022] DELETE /identity/v3/users/3883557cc49240c3ac8d29be591ef4a5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:58.278413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3016a1-e278-49e9-9594-1fc912b9c370 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:58.280497 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b187-77b8-4b63-8780-5fffd844a0a2 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:58.280793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b187-77b8-4b63-8780-5fffd844a0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:58.281094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b187-77b8-4b63-8780-5fffd844a0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:58.316894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1b47b187-77b8-4b63-8780-5fffd844a0a2 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:58.318264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1b47b187-77b8-4b63-8780-5fffd844a0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:58.361537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:58.374942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:58.406901 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:58.407837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:58.408203 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:58.408610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] PATH_INFO: `/v3/projects/71ceebe2bd3647ee98340d6d4421e0e7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:58.410089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ceebe2bd3647ee98340d6d4421e0e7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:58.412278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:58.417580 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1133/2262] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:58.427244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b187-77b8-4b63-8780-5fffd844a0a2 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:58.429049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1b47b187-77b8-4b63-8780-5fffd844a0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:58.507102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ceebe2bd3647ee98340d6d4421e0e7', 'request_id': 'req-711dddad-801e-43f8-9ac3-850e666c65f2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.522215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ceebe2bd3647ee98340d6d4421e0e7', 'request_id': 'req-711dddad-801e-43f8-9ac3-850e666c65f2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.537480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ceebe2bd3647ee98340d6d4421e0e7', 'request_id': 'req-711dddad-801e-43f8-9ac3-850e666c65f2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.563633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] The token cache is being invalidate because project 71ceebe2bd3647ee98340d6d4421e0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:58.563934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.565257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.567766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1130/2263] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:58 2022] DELETE /identity/v3/projects/71ceebe2bd3647ee98340d6d4421e0e7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:58.569835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b187-77b8-4b63-8780-5fffd844a0a2 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:58.571772 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:58.573215 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:58.716043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496491e-d78c-4470-9b8e-c48230d4a164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:58.716758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496491e-d78c-4470-9b8e-c48230d4a164 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:58.717114 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496491e-d78c-4470-9b8e-c48230d4a164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:58.717246 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496491e-d78c-4470-9b8e-c48230d4a164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:58.725488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a496491e-d78c-4470-9b8e-c48230d4a164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:58.730384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dddad-801e-43f8-9ac3-850e666c65f2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:58.735415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:58.736196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:58.736531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:58.736804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] PATH_INFO: `/v3/users/9a2ce3bee43f4b488160705fe24b7703` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:58.739686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2ce3bee43f4b488160705fe24b7703)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:58.741737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:58.742446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496491e-d78c-4470-9b8e-c48230d4a164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:58.745213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496491e-d78c-4470-9b8e-c48230d4a164 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:58.762061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1134/2264] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:09:58.774098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340248f-98cc-45c8-ac2a-7d11ea9fcf96 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:58.776479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340248f-98cc-45c8-ac2a-7d11ea9fcf96 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:58.776479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340248f-98cc-45c8-ac2a-7d11ea9fcf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:58.810309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2ce3bee43f4b488160705fe24b7703'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.811438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2ce3bee43f4b488160705fe24b7703'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.821701 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2ce3bee43f4b488160705fe24b7703'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.836950 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e340248f-98cc-45c8-ac2a-7d11ea9fcf96 None None] MFA Rules not processed for user `94de55a6079d433284ae27c837dad550`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:09:58.838343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2ce3bee43f4b488160705fe24b7703'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.839655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e340248f-98cc-45c8-ac2a-7d11ea9fcf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:58.841018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:58.855569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2ce3bee43f4b488160705fe24b7703'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:58.869196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1131/2265] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:58 2022] DELETE /identity/v3/users/9a2ce3bee43f4b488160705fe24b7703 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:58.961893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1135/2266] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:09:58.966517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:58.968206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:59.067449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1703261-e9e3-4c55-aaf6-8d8fca503fee admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:59.077675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bafa4-7368-49fe-a5f8-93e1ac092d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:59.078412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bafa4-7368-49fe-a5f8-93e1ac092d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:59.078811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bafa4-7368-49fe-a5f8-93e1ac092d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:59.079187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bafa4-7368-49fe-a5f8-93e1ac092d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:59.079934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bafa4-7368-49fe-a5f8-93e1ac092d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:59.082720 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bafa4-7368-49fe-a5f8-93e1ac092d0b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:59.133233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1132/2267] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:09:58 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:59.137318 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340248f-98cc-45c8-ac2a-7d11ea9fcf96 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:59.157486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340248f-98cc-45c8-ac2a-7d11ea9fcf96 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:59.187708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:59.263730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6785b-1498-42e5-8eab-20c3ed6d24da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:59.264917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6785b-1498-42e5-8eab-20c3ed6d24da admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:59.264917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6785b-1498-42e5-8eab-20c3ed6d24da admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:59.265314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6785b-1498-42e5-8eab-20c3ed6d24da admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:59.266292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6785b-1498-42e5-8eab-20c3ed6d24da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:59.269366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6785b-1498-42e5-8eab-20c3ed6d24da admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:59.280024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bafa4-7368-49fe-a5f8-93e1ac092d0b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:59.282816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-590bafa4-7368-49fe-a5f8-93e1ac092d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:59.307792 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bafa4-7368-49fe-a5f8-93e1ac092d0b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:59.318147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:59.319124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:59.320021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:59.320021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] PATH_INFO: `/v3/projects/ca02b6b6839a4f5d9c8301af2971d467` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:59.321246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca02b6b6839a4f5d9c8301af2971d467)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:59.324062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:59.332742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1136/2268] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:09:59 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:09:59.336394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6785b-1498-42e5-8eab-20c3ed6d24da admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:59.347712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6785b-1498-42e5-8eab-20c3ed6d24da admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:59.353732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89885c5-aecc-4fc5-94dd-7e63a0b97727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:59.354500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89885c5-aecc-4fc5-94dd-7e63a0b97727 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:59.354892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89885c5-aecc-4fc5-94dd-7e63a0b97727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:59.355260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89885c5-aecc-4fc5-94dd-7e63a0b97727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:59.356179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89885c5-aecc-4fc5-94dd-7e63a0b97727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:59.357923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89885c5-aecc-4fc5-94dd-7e63a0b97727 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:59.372553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1137/2269] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:59.377677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89885c5-aecc-4fc5-94dd-7e63a0b97727 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:59.390067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89885c5-aecc-4fc5-94dd-7e63a0b97727 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:59.401779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca02b6b6839a4f5d9c8301af2971d467', 'request_id': 'req-8082b283-ed66-462a-a287-6f13c3a199e5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:59.408818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca02b6b6839a4f5d9c8301af2971d467', 'request_id': 'req-8082b283-ed66-462a-a287-6f13c3a199e5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:59.421643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca02b6b6839a4f5d9c8301af2971d467', 'request_id': 'req-8082b283-ed66-462a-a287-6f13c3a199e5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:59.438191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] The token cache is being invalidate because project ca02b6b6839a4f5d9c8301af2971d467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:09:59.438487 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:59.439168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:59.441768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1133/2270] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:59 2022] DELETE /identity/v3/projects/ca02b6b6839a4f5d9c8301af2971d467 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:59.446014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:59.447734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:59.471391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6d3e3-c055-4b94-8625-e2c6f2db5505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:59.472399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6d3e3-c055-4b94-8625-e2c6f2db5505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:59.472813 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6d3e3-c055-4b94-8625-e2c6f2db5505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:59.473111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6d3e3-c055-4b94-8625-e2c6f2db5505 admin admin] PATH_INFO: `/v3/projects/5c51d9b747014ddeae50ce1a8d5efb7e/users/d8ed499915814db09fe7d377a4ffaa31/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:59.493221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6d3e3-c055-4b94-8625-e2c6f2db5505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c51d9b747014ddeae50ce1a8d5efb7e, user_id=d8ed499915814db09fe7d377a4ffaa31, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:59.497132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6d3e3-c055-4b94-8625-e2c6f2db5505 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:59.520201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1138/2271] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:59 2022] PUT /identity/v3/projects/5c51d9b747014ddeae50ce1a8d5efb7e/users/d8ed499915814db09fe7d377a4ffaa31/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:59.524492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6d3e3-c055-4b94-8625-e2c6f2db5505 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:59.526278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b0c6d3e3-c055-4b94-8625-e2c6f2db5505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:59.618618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b283-ed66-462a-a287-6f13c3a199e5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:59.618618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:59.618618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:59.618618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:59.619077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] PATH_INFO: `/v3/users/e0ebd5335aea4c3b9d1333a414a06fa2` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:59.619077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ebd5335aea4c3b9d1333a414a06fa2)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:59.619218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6d3e3-c055-4b94-8625-e2c6f2db5505 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:59.619766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:59.621719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:59.629366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5d8e9-b444-46f6-8210-e2063a159f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:59.631681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d8e9-b444-46f6-8210-e2063a159f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:59.632040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d8e9-b444-46f6-8210-e2063a159f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:59.632398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d8e9-b444-46f6-8210-e2063a159f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:59.633798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5d8e9-b444-46f6-8210-e2063a159f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:59.635535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5d8e9-b444-46f6-8210-e2063a159f6b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:59.649346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1139/2272] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:09:59.653233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5d8e9-b444-46f6-8210-e2063a159f6b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:59.665837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5d8e9-b444-46f6-8210-e2063a159f6b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:09:59.677503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136d9ff-3baa-4187-8e82-0284652daf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:09:59.678508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136d9ff-3baa-4187-8e82-0284652daf1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:09:59.679048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136d9ff-3baa-4187-8e82-0284652daf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:09:59.679529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136d9ff-3baa-4187-8e82-0284652daf1a admin admin] PATH_INFO: `/v3/projects/5c51d9b747014ddeae50ce1a8d5efb7e/users/d8ed499915814db09fe7d377a4ffaa31/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:09:59.681941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136d9ff-3baa-4187-8e82-0284652daf1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c51d9b747014ddeae50ce1a8d5efb7e, user_id=d8ed499915814db09fe7d377a4ffaa31, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:09:59.685191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136d9ff-3baa-4187-8e82-0284652daf1a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:09:59.700471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ebd5335aea4c3b9d1333a414a06fa2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:59.701118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ebd5335aea4c3b9d1333a414a06fa2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:59.701477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1140/2273] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:09:59 2022] PUT /identity/v3/projects/5c51d9b747014ddeae50ce1a8d5efb7e/users/d8ed499915814db09fe7d377a4ffaa31/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:09:59.711828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ebd5335aea4c3b9d1333a414a06fa2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:59.726377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ebd5335aea4c3b9d1333a414a06fa2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:59.741951 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ebd5335aea4c3b9d1333a414a06fa2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:09:59.762545 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1134/2274] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:09:59 2022] DELETE /identity/v3/users/e0ebd5335aea4c3b9d1333a414a06fa2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:09:59.812313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136d9ff-3baa-4187-8e82-0284652daf1a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:09:59.814618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b136d9ff-3baa-4187-8e82-0284652daf1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:09:59.834075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:09:59.934723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136d9ff-3baa-4187-8e82-0284652daf1a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:00.074847 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:00.078886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:00.079171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:00.080427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] PATH_INFO: `/v3/projects/112e4ccbf0044848a08967012c791a14` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:00.081421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112e4ccbf0044848a08967012c791a14)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:00.084963 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:00.172649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112e4ccbf0044848a08967012c791a14', 'request_id': 'req-0ceacdba-3895-43e0-a42b-df50ad2129d7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:00.180508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112e4ccbf0044848a08967012c791a14', 'request_id': 'req-0ceacdba-3895-43e0-a42b-df50ad2129d7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:00.188869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112e4ccbf0044848a08967012c791a14', 'request_id': 'req-0ceacdba-3895-43e0-a42b-df50ad2129d7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:00.211016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] The token cache is being invalidate because project 112e4ccbf0044848a08967012c791a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:00.211968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:00.213509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0ceacdba-3895-43e0-a42b-df50ad2129d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:00.215605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1141/2275] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:09:59 2022] DELETE /identity/v3/projects/112e4ccbf0044848a08967012c791a14 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:00.657743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:00.660350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:00.675000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655becb-8e98-49e7-8d72-7d8bbfca0e43 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:00.770691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:00.771468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:00.771745 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:00.772605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] PATH_INFO: `/v3/projects/7e5e4d4519804defac2870f44a7ab7c6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:00.774187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5e4d4519804defac2870f44a7ab7c6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:00.777019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:00.836790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5e4d4519804defac2870f44a7ab7c6', 'request_id': 'req-9465df65-4178-4abe-b042-0485fd118aed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:00.843912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5e4d4519804defac2870f44a7ab7c6', 'request_id': 'req-9465df65-4178-4abe-b042-0485fd118aed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:00.854585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5e4d4519804defac2870f44a7ab7c6', 'request_id': 'req-9465df65-4178-4abe-b042-0485fd118aed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:00.868824 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] The token cache is being invalidate because project 7e5e4d4519804defac2870f44a7ab7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:00.869399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:00.870270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:00.872252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1135/2276] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:00 2022] DELETE /identity/v3/projects/7e5e4d4519804defac2870f44a7ab7c6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:00.878729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864995f-84f6-4e73-8e43-6f8c153fac89 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:00.880482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864995f-84f6-4e73-8e43-6f8c153fac89 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:00.880871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864995f-84f6-4e73-8e43-6f8c153fac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:00.913201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2864995f-84f6-4e73-8e43-6f8c153fac89 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:00.914681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2864995f-84f6-4e73-8e43-6f8c153fac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:00.950083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:00.952448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:00.969890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:00.992152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:01.019607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1142/2277] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:01.029282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42e26-3279-4609-b9fc-cff13b1fbe97 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:01.030398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42e26-3279-4609-b9fc-cff13b1fbe97 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:01.030398 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42e26-3279-4609-b9fc-cff13b1fbe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:01.055207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465df65-4178-4abe-b042-0485fd118aed admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:01.056196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-25e42e26-3279-4609-b9fc-cff13b1fbe97 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:01.058118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-25e42e26-3279-4609-b9fc-cff13b1fbe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:01.063791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:01.064654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:01.064915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:01.065307 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] PATH_INFO: `/v3/users/e1336475741a44b6977fc83e622c8845` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:01.067517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1336475741a44b6977fc83e622c8845)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:01.069945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:01.077841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1143/2278] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:10:01.083577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42e26-3279-4609-b9fc-cff13b1fbe97 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:01.105818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42e26-3279-4609-b9fc-cff13b1fbe97 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:01.119608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146909df-2352-4bfb-9945-e35510012af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:01.120496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146909df-2352-4bfb-9945-e35510012af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:01.120991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146909df-2352-4bfb-9945-e35510012af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:01.121411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146909df-2352-4bfb-9945-e35510012af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:01.126315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146909df-2352-4bfb-9945-e35510012af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:10:01.126315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146909df-2352-4bfb-9945-e35510012af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:01.129919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146909df-2352-4bfb-9945-e35510012af5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:01.153675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1336475741a44b6977fc83e622c8845'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:01.153965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1336475741a44b6977fc83e622c8845'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:01.160211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1144/2279] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:10:01.162632 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1336475741a44b6977fc83e622c8845'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:01.164525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146909df-2352-4bfb-9945-e35510012af5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:01.182611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146909df-2352-4bfb-9945-e35510012af5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:01.188435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06d2cb-469e-4cc9-8f7d-813ebdc12944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:01.189232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06d2cb-469e-4cc9-8f7d-813ebdc12944 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:01.189665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06d2cb-469e-4cc9-8f7d-813ebdc12944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:01.190118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06d2cb-469e-4cc9-8f7d-813ebdc12944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:01.191627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06d2cb-469e-4cc9-8f7d-813ebdc12944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:01.193743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06d2cb-469e-4cc9-8f7d-813ebdc12944 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:01.204639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1336475741a44b6977fc83e622c8845'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:01.227412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1336475741a44b6977fc83e622c8845'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:01.233238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1145/2280] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:01 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:10:01.237227 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06d2cb-469e-4cc9-8f7d-813ebdc12944 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:01.239892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-be06d2cb-469e-4cc9-8f7d-813ebdc12944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:01.249289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1136/2281] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:00 2022] DELETE /identity/v3/users/e1336475741a44b6977fc83e622c8845 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:01.356511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06d2cb-469e-4cc9-8f7d-813ebdc12944 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:01.492917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5bf5a-619a-47dd-8810-7831a1b16d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:01.493547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5bf5a-619a-47dd-8810-7831a1b16d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:01.493830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5bf5a-619a-47dd-8810-7831a1b16d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:01.494102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5bf5a-619a-47dd-8810-7831a1b16d7d admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:01.494751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5bf5a-619a-47dd-8810-7831a1b16d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:01.497684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5bf5a-619a-47dd-8810-7831a1b16d7d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:01.529693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1146/2282] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:01 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:01.530528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:01.545536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c6bc4-b8d7-46d7-ba32-a30776810458 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:01.552259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b214-ea25-4cdc-af0e-fb3d04ae306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:01.553049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b214-ea25-4cdc-af0e-fb3d04ae306b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:01.553336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b214-ea25-4cdc-af0e-fb3d04ae306b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:01.553610 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b214-ea25-4cdc-af0e-fb3d04ae306b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:01.554420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b214-ea25-4cdc-af0e-fb3d04ae306b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:01.556108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b214-ea25-4cdc-af0e-fb3d04ae306b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:01.583125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5bf5a-619a-47dd-8810-7831a1b16d7d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:01.595785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1137/2283] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:01.599640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5bf5a-619a-47dd-8810-7831a1b16d7d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:01.619706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735d0e7-b624-497f-8c9a-5f5be95bf0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:01.620386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735d0e7-b624-497f-8c9a-5f5be95bf0fb admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:01.621857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735d0e7-b624-497f-8c9a-5f5be95bf0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:01.622143 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735d0e7-b624-497f-8c9a-5f5be95bf0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:01.625109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735d0e7-b624-497f-8c9a-5f5be95bf0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:01.629571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735d0e7-b624-497f-8c9a-5f5be95bf0fb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:01.664900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1147/2284] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:01.665609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b214-ea25-4cdc-af0e-fb3d04ae306b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:01.685377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b214-ea25-4cdc-af0e-fb3d04ae306b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:01.697299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1167b2-8f2c-47f3-80ab-3c5c496aad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:01.704552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1167b2-8f2c-47f3-80ab-3c5c496aad75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:01.705023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1167b2-8f2c-47f3-80ab-3c5c496aad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:01.707266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1167b2-8f2c-47f3-80ab-3c5c496aad75 admin admin] PATH_INFO: `/v3/projects/9f43899cb21540f289a03803e2374596/users/e78efe413d7d4ebd9ae3c81a763c6125/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:01.712443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735d0e7-b624-497f-8c9a-5f5be95bf0fb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:01.714563 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0735d0e7-b624-497f-8c9a-5f5be95bf0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:01.741569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735d0e7-b624-497f-8c9a-5f5be95bf0fb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:01.746765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1167b2-8f2c-47f3-80ab-3c5c496aad75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f43899cb21540f289a03803e2374596, user_id=e78efe413d7d4ebd9ae3c81a763c6125, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:01.750208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1167b2-8f2c-47f3-80ab-3c5c496aad75 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:01.760041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:01.761189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:01.761522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:01.761877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] PATH_INFO: `/v3/projects/4ead3259d33c417186146ef63d302cdc` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:01.765916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ead3259d33c417186146ef63d302cdc)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:01.772170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:01.776912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1138/2285] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:01 2022] PUT /identity/v3/projects/9f43899cb21540f289a03803e2374596/users/e78efe413d7d4ebd9ae3c81a763c6125/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:01.792406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d1b4d-7ad3-4e05-b0fe-945315bc9cc1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:01.794265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d1b4d-7ad3-4e05-b0fe-945315bc9cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:01.794265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d1b4d-7ad3-4e05-b0fe-945315bc9cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:01.871166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:01.880479 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7b8d1b4d-7ad3-4e05-b0fe-945315bc9cc1 None None] MFA Rules not processed for user `e78efe413d7d4ebd9ae3c81a763c6125`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:01.883221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7b8d1b4d-7ad3-4e05-b0fe-945315bc9cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:01.909869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ead3259d33c417186146ef63d302cdc', 'request_id': 'req-bab718c1-a2fd-458c-9745-cb9febe6732c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:01.919674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ead3259d33c417186146ef63d302cdc', 'request_id': 'req-bab718c1-a2fd-458c-9745-cb9febe6732c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:01.929503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ead3259d33c417186146ef63d302cdc', 'request_id': 'req-bab718c1-a2fd-458c-9745-cb9febe6732c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:01.961840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] The token cache is being invalidate because project 4ead3259d33c417186146ef63d302cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:01.962571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:01.964733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:01.967958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1148/2286] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:01 2022] DELETE /identity/v3/projects/4ead3259d33c417186146ef63d302cdc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:10:01.972291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:01.975009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:02.008450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:02.067062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1139/2287] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:02.068868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d1b4d-7ad3-4e05-b0fe-945315bc9cc1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:02.070669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7b8d1b4d-7ad3-4e05-b0fe-945315bc9cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:02.140461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab718c1-a2fd-458c-9745-cb9febe6732c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:02.148210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:02.149505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:02.150198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:02.150623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] PATH_INFO: `/v3/users/73ee3289920c44869d229d3032d8326e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:02.152155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ee3289920c44869d229d3032d8326e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:02.155053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:02.189884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d1b4d-7ad3-4e05-b0fe-945315bc9cc1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:02.197752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea413f-83f2-41ba-bfe2-05d3b159a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:02.199429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea413f-83f2-41ba-bfe2-05d3b159a59e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:02.199429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea413f-83f2-41ba-bfe2-05d3b159a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:02.200847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea413f-83f2-41ba-bfe2-05d3b159a59e admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:02.201801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea413f-83f2-41ba-bfe2-05d3b159a59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:02.205580 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea413f-83f2-41ba-bfe2-05d3b159a59e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:02.242968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ee3289920c44869d229d3032d8326e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:02.244639 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ee3289920c44869d229d3032d8326e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:02.263884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1140/2288] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:02 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:10:02.265358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ee3289920c44869d229d3032d8326e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:02.265850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea413f-83f2-41ba-bfe2-05d3b159a59e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:02.270106 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-34ea413f-83f2-41ba-bfe2-05d3b159a59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:02.280725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ee3289920c44869d229d3032d8326e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:02.320993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ee3289920c44869d229d3032d8326e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:02.341357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1149/2289] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:01 2022] DELETE /identity/v3/users/73ee3289920c44869d229d3032d8326e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:02.421511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea413f-83f2-41ba-bfe2-05d3b159a59e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:02.560190 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd7727-8024-417f-b1c3-373565d46211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:02.561241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7727-8024-417f-b1c3-373565d46211 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:02.561741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7727-8024-417f-b1c3-373565d46211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:02.562811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7727-8024-417f-b1c3-373565d46211 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:02.563924 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd7727-8024-417f-b1c3-373565d46211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:02.567521 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd7727-8024-417f-b1c3-373565d46211 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:02.615033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1141/2290] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:02 2022] POST /identity/v3/users => generated 297 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:02.617233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:02.636305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bd121-1444-44f8-a4bc-3c5f669967fc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:02.648625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b227e-98ae-424c-a776-71630f5b97ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:02.649262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b227e-98ae-424c-a776-71630f5b97ed admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:02.649551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b227e-98ae-424c-a776-71630f5b97ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:02.650122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b227e-98ae-424c-a776-71630f5b97ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:02.650516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b227e-98ae-424c-a776-71630f5b97ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:02.652310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b227e-98ae-424c-a776-71630f5b97ed admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:02.663878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1150/2291] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:02.714718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b227e-98ae-424c-a776-71630f5b97ed admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:02.714891 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd7727-8024-417f-b1c3-373565d46211 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:02.717805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0f5b227e-98ae-424c-a776-71630f5b97ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:02.736658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:02.744221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd7727-8024-417f-b1c3-373565d46211 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:02.754471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b227e-98ae-424c-a776-71630f5b97ed admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:02.771203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:02.771203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:02.771203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:02.771203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] PATH_INFO: `/v3/projects/b4ebdb85732b4bf98fb15c538f1d329f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:02.771618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ebdb85732b4bf98fb15c538f1d329f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:02.773439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:02.792770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:02.794295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b000-d43b-4f35-8c3f-fd68160e9229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:02.795865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b000-d43b-4f35-8c3f-fd68160e9229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:02.798340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b000-d43b-4f35-8c3f-fd68160e9229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:02.799332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b000-d43b-4f35-8c3f-fd68160e9229 admin admin] PATH_INFO: `/v3/projects/061154543be4453d9ff5163bd257d701/users/c49b6e55ae4942c89c953ae0029ef56b/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:02.826515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798b000-d43b-4f35-8c3f-fd68160e9229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061154543be4453d9ff5163bd257d701, user_id=c49b6e55ae4942c89c953ae0029ef56b, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:02.832430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798b000-d43b-4f35-8c3f-fd68160e9229 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:02.836569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ebdb85732b4bf98fb15c538f1d329f', 'request_id': 'req-90b6984d-e3be-4b69-978d-89d2ff7eef46'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:02.845424 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ebdb85732b4bf98fb15c538f1d329f', 'request_id': 'req-90b6984d-e3be-4b69-978d-89d2ff7eef46'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:02.855054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ebdb85732b4bf98fb15c538f1d329f', 'request_id': 'req-90b6984d-e3be-4b69-978d-89d2ff7eef46'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:02.868837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1142/2292] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:02 2022] PUT /identity/v3/projects/061154543be4453d9ff5163bd257d701/users/c49b6e55ae4942c89c953ae0029ef56b/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:02.871870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b000-d43b-4f35-8c3f-fd68160e9229 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:02.874485 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] The token cache is being invalidate because project b4ebdb85732b4bf98fb15c538f1d329f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:02.874989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:02.876149 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90b6984d-e3be-4b69-978d-89d2ff7eef46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:02.884798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1151/2293] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:02 2022] DELETE /identity/v3/projects/b4ebdb85732b4bf98fb15c538f1d329f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:02.887240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5cd7-edff-4f13-8625-918ac258b1df None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:02.887538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5cd7-edff-4f13-8625-918ac258b1df None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:02.887941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5cd7-edff-4f13-8625-918ac258b1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:02.920199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1d2c5cd7-edff-4f13-8625-918ac258b1df None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:02.921640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1d2c5cd7-edff-4f13-8625-918ac258b1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:02.995574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1152/2294] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:03.026155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279203f-af06-4980-8856-4687a1256e29 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.026450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279203f-af06-4980-8856-4687a1256e29 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.026730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279203f-af06-4980-8856-4687a1256e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.049593 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9279203f-af06-4980-8856-4687a1256e29 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:03.051672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9279203f-af06-4980-8856-4687a1256e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:03.061664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1153/2295] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:03.066554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279203f-af06-4980-8856-4687a1256e29 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:03.082669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279203f-af06-4980-8856-4687a1256e29 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:03.093849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e35d5-f4c6-4ffa-ba78-7b3842cdc8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:03.094588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e35d5-f4c6-4ffa-ba78-7b3842cdc8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.094978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e35d5-f4c6-4ffa-ba78-7b3842cdc8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.095222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e35d5-f4c6-4ffa-ba78-7b3842cdc8c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.095955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e35d5-f4c6-4ffa-ba78-7b3842cdc8c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:10:03.096479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e35d5-f4c6-4ffa-ba78-7b3842cdc8c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:03.099189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e35d5-f4c6-4ffa-ba78-7b3842cdc8c1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:03.105443 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b000-d43b-4f35-8c3f-fd68160e9229 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:03.115758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660ac4c-2ca9-4912-bd72-1e999c079154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:03.117180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ac4c-2ca9-4912-bd72-1e999c079154 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.117939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ac4c-2ca9-4912-bd72-1e999c079154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.119204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ac4c-2ca9-4912-bd72-1e999c079154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.119577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1154/2296] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:10:03.120499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660ac4c-2ca9-4912-bd72-1e999c079154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:03.120631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e35d5-f4c6-4ffa-ba78-7b3842cdc8c1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:03.123420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660ac4c-2ca9-4912-bd72-1e999c079154 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:03.132871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e35d5-f4c6-4ffa-ba78-7b3842cdc8c1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:03.142495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8f277-a9e8-4adc-9605-aa090fe0837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:03.147073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8f277-a9e8-4adc-9605-aa090fe0837c admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.147073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8f277-a9e8-4adc-9605-aa090fe0837c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.147310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1143/2297] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:03.147391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8f277-a9e8-4adc-9605-aa090fe0837c admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.147391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8f277-a9e8-4adc-9605-aa090fe0837c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:03.147391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8f277-a9e8-4adc-9605-aa090fe0837c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:03.152387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660ac4c-2ca9-4912-bd72-1e999c079154 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:03.157719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9660ac4c-2ca9-4912-bd72-1e999c079154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:03.174527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660ac4c-2ca9-4912-bd72-1e999c079154 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:03.183522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1155/2298] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:03 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:03.184618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8f277-a9e8-4adc-9605-aa090fe0837c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:03.190228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b81614-c5bc-43b1-ab07-24f6e03a3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:03.191929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b81614-c5bc-43b1-ab07-24f6e03a3229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.193087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b81614-c5bc-43b1-ab07-24f6e03a3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.193560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b81614-c5bc-43b1-ab07-24f6e03a3229 admin admin] PATH_INFO: `/v3/projects/061154543be4453d9ff5163bd257d701/users/c49b6e55ae4942c89c953ae0029ef56b/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.196777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b81614-c5bc-43b1-ab07-24f6e03a3229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061154543be4453d9ff5163bd257d701, user_id=c49b6e55ae4942c89c953ae0029ef56b, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:03.202809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b81614-c5bc-43b1-ab07-24f6e03a3229 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:03.220914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1144/2299] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:03 2022] PUT /identity/v3/projects/061154543be4453d9ff5163bd257d701/users/c49b6e55ae4942c89c953ae0029ef56b/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:03.232045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8999f2-7b98-475a-b571-98d9cc767b31 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.232511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8999f2-7b98-475a-b571-98d9cc767b31 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.232854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8999f2-7b98-475a-b571-98d9cc767b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.270839 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4c8999f2-7b98-475a-b571-98d9cc767b31 None None] MFA Rules not processed for user `c49b6e55ae4942c89c953ae0029ef56b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:03.272068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4c8999f2-7b98-475a-b571-98d9cc767b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:03.288921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8f277-a9e8-4adc-9605-aa090fe0837c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:03.295036 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:03.362557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5970b5-d640-4b41-bb7a-ee40c675c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:03.363566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5970b5-d640-4b41-bb7a-ee40c675c3af admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.363857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5970b5-d640-4b41-bb7a-ee40c675c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.364140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5970b5-d640-4b41-bb7a-ee40c675c3af admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.365154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5970b5-d640-4b41-bb7a-ee40c675c3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:03.367439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5970b5-d640-4b41-bb7a-ee40c675c3af admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:03.374424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1145/2300] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:10:03.383015 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8999f2-7b98-475a-b571-98d9cc767b31 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:03.384643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4c8999f2-7b98-475a-b571-98d9cc767b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:03.405326 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1156/2301] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:03 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:03.410783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5970b5-d640-4b41-bb7a-ee40c675c3af admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:03.441466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5970b5-d640-4b41-bb7a-ee40c675c3af admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:03.460411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150f641-a851-4812-a2d5-c84d18892344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:03.461441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f641-a851-4812-a2d5-c84d18892344 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.461935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f641-a851-4812-a2d5-c84d18892344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.462419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f641-a851-4812-a2d5-c84d18892344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.463286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150f641-a851-4812-a2d5-c84d18892344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:03.468281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150f641-a851-4812-a2d5-c84d18892344 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:03.490002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:03.495493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1157/2302] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:03.496599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150f641-a851-4812-a2d5-c84d18892344 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:03.497145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8999f2-7b98-475a-b571-98d9cc767b31 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:03.504288 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968373e-93ba-487b-9cf1-6bd489ad5871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:03.505896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968373e-93ba-487b-9cf1-6bd489ad5871 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.505896 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968373e-93ba-487b-9cf1-6bd489ad5871 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.506077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968373e-93ba-487b-9cf1-6bd489ad5871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.519633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150f641-a851-4812-a2d5-c84d18892344 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:03.529644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f3426-8900-428d-ac48-7a8c67b857a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:03.530436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f3426-8900-428d-ac48-7a8c67b857a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.530840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f3426-8900-428d-ac48-7a8c67b857a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.531186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f3426-8900-428d-ac48-7a8c67b857a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.531991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f3426-8900-428d-ac48-7a8c67b857a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:03.533712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f3426-8900-428d-ac48-7a8c67b857a3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:03.536439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968373e-93ba-487b-9cf1-6bd489ad5871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:03.542936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968373e-93ba-487b-9cf1-6bd489ad5871 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:03.551610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1158/2303] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:03.552573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f3426-8900-428d-ac48-7a8c67b857a3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:03.564753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f3426-8900-428d-ac48-7a8c67b857a3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:03.571611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1146/2304] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:03.575241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d26f8d-d777-4b54-9b24-fcf28f0ac843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:03.575792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d26f8d-d777-4b54-9b24-fcf28f0ac843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.576088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d26f8d-d777-4b54-9b24-fcf28f0ac843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.577175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d26f8d-d777-4b54-9b24-fcf28f0ac843 admin admin] PATH_INFO: `/v3/projects/dc6527d50aa6471595dc95bb4b44f88c/users/16d9d7df2d18416aac1e30cc02959bc7/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.598296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d26f8d-d777-4b54-9b24-fcf28f0ac843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6527d50aa6471595dc95bb4b44f88c, user_id=16d9d7df2d18416aac1e30cc02959bc7, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:03.603127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d26f8d-d777-4b54-9b24-fcf28f0ac843 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:03.626678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1159/2305] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:03 2022] PUT /identity/v3/projects/dc6527d50aa6471595dc95bb4b44f88c/users/16d9d7df2d18416aac1e30cc02959bc7/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:03.639443 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72446-1666-4642-918b-4fd575915711 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:03.639871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72446-1666-4642-918b-4fd575915711 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:03.640252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72446-1666-4642-918b-4fd575915711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:03.688357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dec72446-1666-4642-918b-4fd575915711 None None] MFA Rules not processed for user `16d9d7df2d18416aac1e30cc02959bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:03.690855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dec72446-1666-4642-918b-4fd575915711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:03.880474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1147/2306] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:03.891855 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d26f8d-d777-4b54-9b24-fcf28f0ac843 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:04.016004 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d26f8d-d777-4b54-9b24-fcf28f0ac843 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:04.028570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9813e8-3bbf-493c-bf78-60a8efedec07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:04.029319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9813e8-3bbf-493c-bf78-60a8efedec07 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:04.029653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9813e8-3bbf-493c-bf78-60a8efedec07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:04.030258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9813e8-3bbf-493c-bf78-60a8efedec07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:04.044344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9813e8-3bbf-493c-bf78-60a8efedec07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:04.046125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9813e8-3bbf-493c-bf78-60a8efedec07 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:04.067243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1160/2307] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:04.091917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72446-1666-4642-918b-4fd575915711 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:04.258879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9813e8-3bbf-493c-bf78-60a8efedec07 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:04.311304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72446-1666-4642-918b-4fd575915711 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:04.321231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:04.321900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:04.322179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:04.322457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] PATH_INFO: `/v3/users/16d9d7df2d18416aac1e30cc02959bc7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:04.323842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d9d7df2d18416aac1e30cc02959bc7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:04.326147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:04.381416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:04.406608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9813e8-3bbf-493c-bf78-60a8efedec07 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:04.419120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0fecb-7e86-4925-957b-eaacd5a9b83a tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b6e55ae4942c89c953ae0029ef56b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061154543be4453d9ff5163bd257d701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:04.419846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0fecb-7e86-4925-957b-eaacd5a9b83a tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:04.420199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0fecb-7e86-4925-957b-eaacd5a9b83a tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:04.420583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0fecb-7e86-4925-957b-eaacd5a9b83a tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:04.421314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0fecb-7e86-4925-957b-eaacd5a9b83a tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:10:04.422318 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0fecb-7e86-4925-957b-eaacd5a9b83a tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:04.434678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0fecb-7e86-4925-957b-eaacd5a9b83a tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:04.446817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d9d7df2d18416aac1e30cc02959bc7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:04.447961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d9d7df2d18416aac1e30cc02959bc7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:04.462733 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d9d7df2d18416aac1e30cc02959bc7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:04.469324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1161/2308] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:10:04.470773 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0fecb-7e86-4925-957b-eaacd5a9b83a tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:04.492865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0fecb-7e86-4925-957b-eaacd5a9b83a tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:04.494450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d9d7df2d18416aac1e30cc02959bc7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:04.506162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c4eac-c147-4448-9e04-dfa593f2cf63 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b6e55ae4942c89c953ae0029ef56b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061154543be4453d9ff5163bd257d701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:04.507269 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c4eac-c147-4448-9e04-dfa593f2cf63 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:04.507269 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c4eac-c147-4448-9e04-dfa593f2cf63 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:04.507533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c4eac-c147-4448-9e04-dfa593f2cf63 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:04.509533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2c930507-5bf2-4219-a00e-601720c948d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d9d7df2d18416aac1e30cc02959bc7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:04.509678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c4eac-c147-4448-9e04-dfa593f2cf63 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:04.513895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:04.515935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c4eac-c147-4448-9e04-dfa593f2cf63 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:04.524006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1148/2309] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:04 2022] DELETE /identity/v3/users/16d9d7df2d18416aac1e30cc02959bc7 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:04.530791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905ffd0-a3a6-4bce-883e-9be7318e5943 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:04.531861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905ffd0-a3a6-4bce-883e-9be7318e5943 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:04.539721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905ffd0-a3a6-4bce-883e-9be7318e5943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:04.591273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1162/2310] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:04 2022] POST /identity/v3/projects => generated 354 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:04.592118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2905ffd0-a3a6-4bce-883e-9be7318e5943 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:04.593712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2905ffd0-a3a6-4bce-883e-9be7318e5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:04.595651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c4eac-c147-4448-9e04-dfa593f2cf63 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:04.600240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d43c4eac-c147-4448-9e04-dfa593f2cf63 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:04.702161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1149/2311] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:04.711568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905ffd0-a3a6-4bce-883e-9be7318e5943 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:04.713399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2905ffd0-a3a6-4bce-883e-9be7318e5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:04.756664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c4eac-c147-4448-9e04-dfa593f2cf63 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:04.774115 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa48f2-c353-4a35-868d-21a41515f754 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b6e55ae4942c89c953ae0029ef56b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061154543be4453d9ff5163bd257d701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:04.774766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa48f2-c353-4a35-868d-21a41515f754 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:04.775113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa48f2-c353-4a35-868d-21a41515f754 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:04.775399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa48f2-c353-4a35-868d-21a41515f754 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:04.776077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa48f2-c353-4a35-868d-21a41515f754 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:10:04.776425 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa48f2-c353-4a35-868d-21a41515f754 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:04.778195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa48f2-c353-4a35-868d-21a41515f754 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:04.801729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1163/2312] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:10:04.805470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905ffd0-a3a6-4bce-883e-9be7318e5943 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:04.811114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa756717-b4b0-4ac4-befe-5ba999a645fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:04.811977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756717-b4b0-4ac4-befe-5ba999a645fa service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:04.812501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756717-b4b0-4ac4-befe-5ba999a645fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:04.813660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756717-b4b0-4ac4-befe-5ba999a645fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:04.838657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa756717-b4b0-4ac4-befe-5ba999a645fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:04.840754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa756717-b4b0-4ac4-befe-5ba999a645fa service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:04.857517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1150/2313] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:04.859239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa48f2-c353-4a35-868d-21a41515f754 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:04.871832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa48f2-c353-4a35-868d-21a41515f754 tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:04.879548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b6e55ae4942c89c953ae0029ef56b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061154543be4453d9ff5163bd257d701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:04.880555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:04.880916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:04.881263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] PATH_INFO: `/v3/projects/d4792df5b43341f98d9d12883bdde754` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:04.882503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4792df5b43341f98d9d12883bdde754)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:04.884540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:04.975796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4792df5b43341f98d9d12883bdde754', 'request_id': 'req-a49c960a-335a-4daf-94de-529af4c2a3af'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:04.986058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4792df5b43341f98d9d12883bdde754', 'request_id': 'req-a49c960a-335a-4daf-94de-529af4c2a3af'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:04.996286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4792df5b43341f98d9d12883bdde754', 'request_id': 'req-a49c960a-335a-4daf-94de-529af4c2a3af'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.021960 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] The token cache is being invalidate because project d4792df5b43341f98d9d12883bdde754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:05.022283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.025405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.027118 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1164/2314] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:04 2022] DELETE /identity/v3/projects/d4792df5b43341f98d9d12883bdde754 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:05.307058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa756717-b4b0-4ac4-befe-5ba999a645fa service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:05.308690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-aa756717-b4b0-4ac4-befe-5ba999a645fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:05.334791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:05.335450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa756717-b4b0-4ac4-befe-5ba999a645fa service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:05.336237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:05.417566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:05.433805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:05.434639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:05.435019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:05.435646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] PATH_INFO: `/v3/users/e78efe413d7d4ebd9ae3c81a763c6125` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:05.437131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78efe413d7d4ebd9ae3c81a763c6125)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:05.439238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:05.447925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c960a-335a-4daf-94de-529af4c2a3af tempest-VolumeQuotaClassesTest-1075307014 tempest-VolumeQuotaClassesTest-1075307014-project-admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:05.453514 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:05.454356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:05.455856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:05.455856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] PATH_INFO: `/v3/projects/dc6527d50aa6471595dc95bb4b44f88c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:05.457590 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6527d50aa6471595dc95bb4b44f88c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:05.460100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:05.544220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6527d50aa6471595dc95bb4b44f88c', 'request_id': 'req-27805de7-0c2b-4552-ac97-aa64f109275f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.553448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6527d50aa6471595dc95bb4b44f88c', 'request_id': 'req-27805de7-0c2b-4552-ac97-aa64f109275f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.555575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:05.559277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78efe413d7d4ebd9ae3c81a763c6125'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.560352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78efe413d7d4ebd9ae3c81a763c6125'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.565557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6527d50aa6471595dc95bb4b44f88c', 'request_id': 'req-27805de7-0c2b-4552-ac97-aa64f109275f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.572358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78efe413d7d4ebd9ae3c81a763c6125'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.590880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] The token cache is being invalidate because project dc6527d50aa6471595dc95bb4b44f88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:05.592240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.592917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78efe413d7d4ebd9ae3c81a763c6125'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.594311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27805de7-0c2b-4552-ac97-aa64f109275f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.598801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1165/2315] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:05 2022] DELETE /identity/v3/projects/dc6527d50aa6471595dc95bb4b44f88c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:05.604666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a71f9b-af6b-411d-9e14-dd578d9bf58a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:05.605739 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a71f9b-af6b-411d-9e14-dd578d9bf58a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:05.607507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba61dffe-f1b8-4f79-a57a-ab0a2dd08841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78efe413d7d4ebd9ae3c81a763c6125'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:05.608383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a71f9b-af6b-411d-9e14-dd578d9bf58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:05.618366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1151/2316] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:05 2022] DELETE /identity/v3/users/e78efe413d7d4ebd9ae3c81a763c6125 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:10:05.619966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682bff-5dee-4042-ad6b-e918bbc757fc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:05.620383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682bff-5dee-4042-ad6b-e918bbc757fc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:05.620808 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682bff-5dee-4042-ad6b-e918bbc757fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:05.642666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d7682bff-5dee-4042-ad6b-e918bbc757fc None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:05.646033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d7682bff-5dee-4042-ad6b-e918bbc757fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:05.665093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-52a71f9b-af6b-411d-9e14-dd578d9bf58a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:05.666387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-52a71f9b-af6b-411d-9e14-dd578d9bf58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:05.759063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1152/2317] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:05.766466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682bff-5dee-4042-ad6b-e918bbc757fc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:05.769053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d7682bff-5dee-4042-ad6b-e918bbc757fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:05.777321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1166/2318] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:05.789221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2113ef-6012-4021-b45b-11e7abaee244 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:05.789744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2113ef-6012-4021-b45b-11e7abaee244 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:05.790095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2113ef-6012-4021-b45b-11e7abaee244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:05.817314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ad2113ef-6012-4021-b45b-11e7abaee244 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:05.819536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ad2113ef-6012-4021-b45b-11e7abaee244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:05.829032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1167/2319] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:05.837266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2113ef-6012-4021-b45b-11e7abaee244 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:05.848165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2113ef-6012-4021-b45b-11e7abaee244 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:05.862104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aeb80-bfda-487c-b27f-781ed2f32623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:05.862791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aeb80-bfda-487c-b27f-781ed2f32623 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:05.863088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aeb80-bfda-487c-b27f-781ed2f32623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:05.863495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aeb80-bfda-487c-b27f-781ed2f32623 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:05.864871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aeb80-bfda-487c-b27f-781ed2f32623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:10:05.865785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aeb80-bfda-487c-b27f-781ed2f32623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:05.871935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aeb80-bfda-487c-b27f-781ed2f32623 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:05.885466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682bff-5dee-4042-ad6b-e918bbc757fc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:05.898386 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74211d-52f6-481a-b028-46a87430349d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:05.899094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74211d-52f6-481a-b028-46a87430349d service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:05.899447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74211d-52f6-481a-b028-46a87430349d service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:05.899675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74211d-52f6-481a-b028-46a87430349d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:05.901774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1168/2320] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:10:05.902787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aeb80-bfda-487c-b27f-781ed2f32623 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:05.918240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74211d-52f6-481a-b028-46a87430349d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:05.919355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74211d-52f6-481a-b028-46a87430349d service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:05.930114 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aeb80-bfda-487c-b27f-781ed2f32623 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:05.943058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1153/2321] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:10:05.944702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d242de3-2884-4f01-a6e5-c46b4b22a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:05.945345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242de3-2884-4f01-a6e5-c46b4b22a37a admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:05.945633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242de3-2884-4f01-a6e5-c46b4b22a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:05.946066 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242de3-2884-4f01-a6e5-c46b4b22a37a admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:05.946723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d242de3-2884-4f01-a6e5-c46b4b22a37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:05.948680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d242de3-2884-4f01-a6e5-c46b4b22a37a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:06.027053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1169/2322] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:05 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:06.028962 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74211d-52f6-481a-b028-46a87430349d service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:06.055662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74211d-52f6-481a-b028-46a87430349d service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:06.168912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc2a59-fb3e-4ee6-8922-356308e2ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:06.170106 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2a59-fb3e-4ee6-8922-356308e2ff5c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:06.170595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2a59-fb3e-4ee6-8922-356308e2ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:06.171114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2a59-fb3e-4ee6-8922-356308e2ff5c admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:06.172136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc2a59-fb3e-4ee6-8922-356308e2ff5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:06.175726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc2a59-fb3e-4ee6-8922-356308e2ff5c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:06.195716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:06.218520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1154/2323] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:06 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:06.225475 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d242de3-2884-4f01-a6e5-c46b4b22a37a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:06.247542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d242de3-2884-4f01-a6e5-c46b4b22a37a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:06.253910 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddc136-3011-48db-975b-bbda6aed7dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:06.254731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddc136-3011-48db-975b-bbda6aed7dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:06.255102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddc136-3011-48db-975b-bbda6aed7dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:06.255789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddc136-3011-48db-975b-bbda6aed7dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:06.256803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddc136-3011-48db-975b-bbda6aed7dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:06.258499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddc136-3011-48db-975b-bbda6aed7dc4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:06.286405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc2a59-fb3e-4ee6-8922-356308e2ff5c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:06.286854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1170/2324] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:06.297759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc2a59-fb3e-4ee6-8922-356308e2ff5c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:06.312848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a1152-832e-457c-baff-16c7f5b43519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:06.314592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a1152-832e-457c-baff-16c7f5b43519 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:06.315132 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a1152-832e-457c-baff-16c7f5b43519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:06.316417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a1152-832e-457c-baff-16c7f5b43519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:06.317501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a1152-832e-457c-baff-16c7f5b43519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:06.319294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a1152-832e-457c-baff-16c7f5b43519 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:06.358673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1155/2325] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:06.361670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddc136-3011-48db-975b-bbda6aed7dc4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:06.374867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddc136-3011-48db-975b-bbda6aed7dc4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:06.380675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a1152-832e-457c-baff-16c7f5b43519 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:06.383111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9b4a1152-832e-457c-baff-16c7f5b43519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:06.403954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a66b2-7fb7-47e5-85f1-92e75c3f026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:06.405369 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a66b2-7fb7-47e5-85f1-92e75c3f026e admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:06.405656 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a66b2-7fb7-47e5-85f1-92e75c3f026e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:06.408013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a66b2-7fb7-47e5-85f1-92e75c3f026e admin admin] PATH_INFO: `/v3/projects/437da6457aa540bd94a0e3ad8fc4c087/users/dc9f7a90f6fb49ca92ce004e315ee067/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:06.432021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a1152-832e-457c-baff-16c7f5b43519 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:06.444975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:06.446878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:06.447386 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:06.448008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] PATH_INFO: `/v3/projects/9f43899cb21540f289a03803e2374596` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:06.451275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f43899cb21540f289a03803e2374596)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:06.455867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a66b2-7fb7-47e5-85f1-92e75c3f026e admin admin] RBAC: Authorizing `identity:create_grant(project_id=437da6457aa540bd94a0e3ad8fc4c087, user_id=dc9f7a90f6fb49ca92ce004e315ee067, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:06.457959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:06.463228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a66b2-7fb7-47e5-85f1-92e75c3f026e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:06.489963 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:06.509643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1171/2326] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:06 2022] PUT /identity/v3/projects/437da6457aa540bd94a0e3ad8fc4c087/users/dc9f7a90f6fb49ca92ce004e315ee067/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:06.528846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f90e0-756e-40e1-8247-01ae940874f7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:06.529566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f90e0-756e-40e1-8247-01ae940874f7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:06.533911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f90e0-756e-40e1-8247-01ae940874f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:06.586729 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f43899cb21540f289a03803e2374596', 'request_id': 'req-13b58720-8e70-4ee3-b8df-ae367e8bae55'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:06.596451 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6d1f90e0-756e-40e1-8247-01ae940874f7 None None] MFA Rules not processed for user `dc9f7a90f6fb49ca92ce004e315ee067`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:06.598882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6d1f90e0-756e-40e1-8247-01ae940874f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:06.624898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f43899cb21540f289a03803e2374596', 'request_id': 'req-13b58720-8e70-4ee3-b8df-ae367e8bae55'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:06.638618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f43899cb21540f289a03803e2374596', 'request_id': 'req-13b58720-8e70-4ee3-b8df-ae367e8bae55'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:06.655476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] The token cache is being invalidate because project 9f43899cb21540f289a03803e2374596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:06.655785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:06.656541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:06.658287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1156/2327] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:06 2022] DELETE /identity/v3/projects/9f43899cb21540f289a03803e2374596 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:06.663222 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:06.665741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:06.740666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1172/2328] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:06.748614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f90e0-756e-40e1-8247-01ae940874f7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:06.750547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6d1f90e0-756e-40e1-8247-01ae940874f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:06.862265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58720-8e70-4ee3-b8df-ae367e8bae55 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:06.888026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:06.889541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:06.889825 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:06.890104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] PATH_INFO: `/v3/users/c49b6e55ae4942c89c953ae0029ef56b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:06.893083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49b6e55ae4942c89c953ae0029ef56b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:06.896237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:06.908049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f90e0-756e-40e1-8247-01ae940874f7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:06.917928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88e666-25fd-4c02-ae17-81218cd832a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:06.918708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e666-25fd-4c02-ae17-81218cd832a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:06.918998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e666-25fd-4c02-ae17-81218cd832a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:06.919277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e666-25fd-4c02-ae17-81218cd832a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:06.919932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88e666-25fd-4c02-ae17-81218cd832a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:06.922460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88e666-25fd-4c02-ae17-81218cd832a6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:06.986778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1173/2329] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:06 2022] POST /identity/v3/projects => generated 375 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:06.993513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88e666-25fd-4c02-ae17-81218cd832a6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:06.997988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49b6e55ae4942c89c953ae0029ef56b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:06.999528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49b6e55ae4942c89c953ae0029ef56b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:07.019120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49b6e55ae4942c89c953ae0029ef56b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:07.042202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:07.046104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49b6e55ae4942c89c953ae0029ef56b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:07.062082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a60ca26b-9231-4a35-b554-ad934054d53d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49b6e55ae4942c89c953ae0029ef56b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:07.090090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1157/2330] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:06 2022] DELETE /identity/v3/users/c49b6e55ae4942c89c953ae0029ef56b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:07.092208 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035d9cc-55ca-4567-ae7f-0e845c394f80 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:07.092626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035d9cc-55ca-4567-ae7f-0e845c394f80 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:07.093090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035d9cc-55ca-4567-ae7f-0e845c394f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:07.143049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88e666-25fd-4c02-ae17-81218cd832a6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:07.173331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1035d9cc-55ca-4567-ae7f-0e845c394f80 None None] MFA Rules not processed for user `d8ed499915814db09fe7d377a4ffaa31`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:07.174484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1035d9cc-55ca-4567-ae7f-0e845c394f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:07.178565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:07.268995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e11a1f-cc0e-41c1-9853-63dff86b64b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:07.269718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e11a1f-cc0e-41c1-9853-63dff86b64b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:07.270000 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e11a1f-cc0e-41c1-9853-63dff86b64b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:07.270272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e11a1f-cc0e-41c1-9853-63dff86b64b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:07.270921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e11a1f-cc0e-41c1-9853-63dff86b64b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:07.272929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e11a1f-cc0e-41c1-9853-63dff86b64b7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:07.305059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1174/2331] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:06 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:07.309676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e11a1f-cc0e-41c1-9853-63dff86b64b7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:07.312928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-19e11a1f-cc0e-41c1-9853-63dff86b64b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:07.314118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1158/2332] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:07.328353 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035d9cc-55ca-4567-ae7f-0e845c394f80 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:07.330087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1035d9cc-55ca-4567-ae7f-0e845c394f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:07.339801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e11a1f-cc0e-41c1-9853-63dff86b64b7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:07.346792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461d537-903a-492c-bc5d-4422765aaff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:07.347520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461d537-903a-492c-bc5d-4422765aaff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:07.347737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461d537-903a-492c-bc5d-4422765aaff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:07.348064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461d537-903a-492c-bc5d-4422765aaff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:07.348717 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461d537-903a-492c-bc5d-4422765aaff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:07.350373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461d537-903a-492c-bc5d-4422765aaff0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:07.388539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1175/2333] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:07.389965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461d537-903a-492c-bc5d-4422765aaff0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:07.403116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461d537-903a-492c-bc5d-4422765aaff0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:07.411204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6683-a670-4dd4-ab98-45a528329f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:07.412068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6683-a670-4dd4-ab98-45a528329f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:07.412530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6683-a670-4dd4-ab98-45a528329f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:07.412818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6683-a670-4dd4-ab98-45a528329f13 admin admin] PATH_INFO: `/v3/projects/3aa1e75f23744f3ea9976bf4ff0c77ce/users/31275ac2f5044b9c921d1d8ed8771e75/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:07.433987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e6683-a670-4dd4-ab98-45a528329f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa1e75f23744f3ea9976bf4ff0c77ce, user_id=31275ac2f5044b9c921d1d8ed8771e75, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:07.441359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e6683-a670-4dd4-ab98-45a528329f13 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:07.461613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1176/2334] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:07 2022] PUT /identity/v3/projects/3aa1e75f23744f3ea9976bf4ff0c77ce/users/31275ac2f5044b9c921d1d8ed8771e75/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:07.463354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035d9cc-55ca-4567-ae7f-0e845c394f80 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:07.466009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6683-a670-4dd4-ab98-45a528329f13 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:07.552630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5b85b-8596-4b94-9c3f-5ef47a3da076 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb70dd34dc642cfbb49b4e1a0434399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:07.553262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5b85b-8596-4b94-9c3f-5ef47a3da076 service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:07.553555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5b85b-8596-4b94-9c3f-5ef47a3da076 service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:07.554294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5b85b-8596-4b94-9c3f-5ef47a3da076 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:07.557249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-54a5b85b-8596-4b94-9c3f-5ef47a3da076 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:07.612106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6683-a670-4dd4-ab98-45a528329f13 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:07.619035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afced80d-2af1-45bb-aec6-8dab8a416a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:07.619701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afced80d-2af1-45bb-aec6-8dab8a416a16 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:07.620463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afced80d-2af1-45bb-aec6-8dab8a416a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:07.620852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afced80d-2af1-45bb-aec6-8dab8a416a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:07.621435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afced80d-2af1-45bb-aec6-8dab8a416a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:07.623412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afced80d-2af1-45bb-aec6-8dab8a416a16 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:07.623869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:07.640235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1177/2335] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:07.641172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afced80d-2af1-45bb-aec6-8dab8a416a16 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:07.647263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-afced80d-2af1-45bb-aec6-8dab8a416a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:07.663714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5b85b-8596-4b94-9c3f-5ef47a3da076 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:07.665464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5b85b-8596-4b94-9c3f-5ef47a3da076 service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:07.674076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afced80d-2af1-45bb-aec6-8dab8a416a16 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:07.681596 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1159/2336] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:07.681877 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:07.682352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5b85b-8596-4b94-9c3f-5ef47a3da076 service glance] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:07.683097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:07.683611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:07.684057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] PATH_INFO: `/v3/projects/061154543be4453d9ff5163bd257d701` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:07.688871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=061154543be4453d9ff5163bd257d701)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:07.692799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:07.718952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5b85b-8596-4b94-9c3f-5ef47a3da076 service glance] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:07.730098 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b78b3-e61a-4bf8-ad44-0bd2df085f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:07.731079 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b78b3-e61a-4bf8-ad44-0bd2df085f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:07.731459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b78b3-e61a-4bf8-ad44-0bd2df085f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:07.731914 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b78b3-e61a-4bf8-ad44-0bd2df085f17 admin admin] PATH_INFO: `/v3/projects/3aa1e75f23744f3ea9976bf4ff0c77ce/users/31275ac2f5044b9c921d1d8ed8771e75/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:07.738825 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b78b3-e61a-4bf8-ad44-0bd2df085f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa1e75f23744f3ea9976bf4ff0c77ce, user_id=31275ac2f5044b9c921d1d8ed8771e75, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:07.751543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b78b3-e61a-4bf8-ad44-0bd2df085f17 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:07.775481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1160/2337] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:07 2022] PUT /identity/v3/projects/3aa1e75f23744f3ea9976bf4ff0c77ce/users/31275ac2f5044b9c921d1d8ed8771e75/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:07.791646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebbd9f-d13d-4e70-83f0-c698cff76813 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:07.793187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebbd9f-d13d-4e70-83f0-c698cff76813 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:07.795070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebbd9f-d13d-4e70-83f0-c698cff76813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:07.799693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061154543be4453d9ff5163bd257d701', 'request_id': 'req-1a6ed58b-29a8-419b-aac7-a75422846fa5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:07.812804 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061154543be4453d9ff5163bd257d701', 'request_id': 'req-1a6ed58b-29a8-419b-aac7-a75422846fa5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:07.829260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061154543be4453d9ff5163bd257d701', 'request_id': 'req-1a6ed58b-29a8-419b-aac7-a75422846fa5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:07.833876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:07.837888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f5ebbd9f-d13d-4e70-83f0-c698cff76813 None None] MFA Rules not processed for user `31275ac2f5044b9c921d1d8ed8771e75`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:07.839572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f5ebbd9f-d13d-4e70-83f0-c698cff76813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:07.879968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] The token cache is being invalidate because project 061154543be4453d9ff5163bd257d701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:07.880283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:07.881734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1a6ed58b-29a8-419b-aac7-a75422846fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:07.883629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1178/2338] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:07 2022] DELETE /identity/v3/projects/061154543be4453d9ff5163bd257d701 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:07.890925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dc017-0ea2-4546-b7db-9751cee8d92c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:07.891111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dc017-0ea2-4546-b7db-9751cee8d92c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:07.891346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dc017-0ea2-4546-b7db-9751cee8d92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:07.952853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-882dc017-0ea2-4546-b7db-9751cee8d92c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:07.954342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-882dc017-0ea2-4546-b7db-9751cee8d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:08.007957 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1161/2339] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:08.009081 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebbd9f-d13d-4e70-83f0-c698cff76813 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:08.030054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f5ebbd9f-d13d-4e70-83f0-c698cff76813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:08.089039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1179/2340] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:08.089730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dc017-0ea2-4546-b7db-9751cee8d92c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:08.091045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-882dc017-0ea2-4546-b7db-9751cee8d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:08.134168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebbd9f-d13d-4e70-83f0-c698cff76813 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:08.140832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:08.141570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.141860 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.142696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] PATH_INFO: `/v3/users/bed884a3d388403cbdc3d9742b53fc94` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.144966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed884a3d388403cbdc3d9742b53fc94)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:08.146926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:08.175704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dc017-0ea2-4546-b7db-9751cee8d92c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:08.185229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef1ded-a4ab-4f6c-b345-68106a59cc1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:08.185915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef1ded-a4ab-4f6c-b345-68106a59cc1a service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.186216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef1ded-a4ab-4f6c-b345-68106a59cc1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.186495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef1ded-a4ab-4f6c-b345-68106a59cc1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.188467 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2bef1ded-a4ab-4f6c-b345-68106a59cc1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:08.237984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed884a3d388403cbdc3d9742b53fc94'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:08.238784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed884a3d388403cbdc3d9742b53fc94'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:08.249259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed884a3d388403cbdc3d9742b53fc94'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:08.252076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:08.271542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed884a3d388403cbdc3d9742b53fc94'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:08.277796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef1ded-a4ab-4f6c-b345-68106a59cc1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:08.279252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef1ded-a4ab-4f6c-b345-68106a59cc1a service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:08.280547 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-828c038c-2620-4e04-95c2-4b9f13cc4b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed884a3d388403cbdc3d9742b53fc94'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:08.289128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1162/2341] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:08 2022] DELETE /identity/v3/users/bed884a3d388403cbdc3d9742b53fc94 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:08.290212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b355-8ae6-40aa-a9a7-5251d822f40e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.290505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b355-8ae6-40aa-a9a7-5251d822f40e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.290785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b355-8ae6-40aa-a9a7-5251d822f40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.293367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1180/2342] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:08.295578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9fd45-6822-468b-beb7-8bc0a565a2ee None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.296159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9fd45-6822-468b-beb7-8bc0a565a2ee None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.296522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9fd45-6822-468b-beb7-8bc0a565a2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.322672 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d5b9fd45-6822-468b-beb7-8bc0a565a2ee None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:08.324399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d5b9fd45-6822-468b-beb7-8bc0a565a2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:08.328039 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8728b355-8ae6-40aa-a9a7-5251d822f40e None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:08.329303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8728b355-8ae6-40aa-a9a7-5251d822f40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:08.378900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:08.401106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1181/2343] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:08.402601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1ad16-d8ec-4484-b2b8-d100d6fbde66 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.404318 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1ad16-d8ec-4484-b2b8-d100d6fbde66 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.404628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1ad16-d8ec-4484-b2b8-d100d6fbde66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.418046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1163/2344] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:08.419014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728b355-8ae6-40aa-a9a7-5251d822f40e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:08.430978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728b355-8ae6-40aa-a9a7-5251d822f40e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:08.436465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56358-ffda-4ba8-82de-639185d83eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:08.437168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56358-ffda-4ba8-82de-639185d83eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.437519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56358-ffda-4ba8-82de-639185d83eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.437902 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56358-ffda-4ba8-82de-639185d83eeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.438636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a56358-ffda-4ba8-82de-639185d83eeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:10:08.439020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a56358-ffda-4ba8-82de-639185d83eeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:08.440822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a56358-ffda-4ba8-82de-639185d83eeb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:08.454148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1164/2345] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:10:08.460259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56358-ffda-4ba8-82de-639185d83eeb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:08.468545 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a5b1ad16-d8ec-4484-b2b8-d100d6fbde66 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:08.470266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a5b1ad16-d8ec-4484-b2b8-d100d6fbde66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:08.473261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56358-ffda-4ba8-82de-639185d83eeb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:08.478249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392efa79-2fb6-4e97-ba66-f251b1725e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:08.478943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392efa79-2fb6-4e97-ba66-f251b1725e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.479316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392efa79-2fb6-4e97-ba66-f251b1725e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.479673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392efa79-2fb6-4e97-ba66-f251b1725e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.480429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392efa79-2fb6-4e97-ba66-f251b1725e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:08.482434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392efa79-2fb6-4e97-ba66-f251b1725e1d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:08.502835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1182/2346] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:08.505595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1ad16-d8ec-4484-b2b8-d100d6fbde66 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:08.519862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a5b1ad16-d8ec-4484-b2b8-d100d6fbde66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:08.532648 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1165/2347] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:08 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:08.533753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392efa79-2fb6-4e97-ba66-f251b1725e1d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:08.536858 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-392efa79-2fb6-4e97-ba66-f251b1725e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:08.620202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392efa79-2fb6-4e97-ba66-f251b1725e1d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:08.624604 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3844668-041c-45e6-9cae-51cb921da9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:08.625287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3844668-041c-45e6-9cae-51cb921da9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.625664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3844668-041c-45e6-9cae-51cb921da9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.626012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3844668-041c-45e6-9cae-51cb921da9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.640262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1ad16-d8ec-4484-b2b8-d100d6fbde66 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:08.741189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b615c60-4986-46f3-8a60-85b55ec6d4d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:08.741752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b615c60-4986-46f3-8a60-85b55ec6d4d6 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.741998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:08.742101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b615c60-4986-46f3-8a60-85b55ec6d4d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.742297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b615c60-4986-46f3-8a60-85b55ec6d4d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.748397 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3844668-041c-45e6-9cae-51cb921da9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:08.750032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3844668-041c-45e6-9cae-51cb921da9b1 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:08.761936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1166/2348] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:08.762810 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3844668-041c-45e6-9cae-51cb921da9b1 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:08.773088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3844668-041c-45e6-9cae-51cb921da9b1 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:08.782837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1421a2-fc74-44e4-b335-e6c7ef46bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:08.783509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1421a2-fc74-44e4-b335-e6c7ef46bda6 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.783819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1421a2-fc74-44e4-b335-e6c7ef46bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.784099 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1421a2-fc74-44e4-b335-e6c7ef46bda6 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.785445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1421a2-fc74-44e4-b335-e6c7ef46bda6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:08.788836 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1421a2-fc74-44e4-b335-e6c7ef46bda6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:08.815345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b615c60-4986-46f3-8a60-85b55ec6d4d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:08.818058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b615c60-4986-46f3-8a60-85b55ec6d4d6 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:08.833537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1183/2349] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:10:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:10:08.836453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1167/2350] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:08 2022] POST /identity/v3/users => generated 293 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:08.840397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b615c60-4986-46f3-8a60-85b55ec6d4d6 service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:08.860955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b615c60-4986-46f3-8a60-85b55ec6d4d6 service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:08.869269 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f1aa-4c88-4bb7-b16b-8e4b442548ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:08.870249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f1aa-4c88-4bb7-b16b-8e4b442548ba admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.870601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f1aa-4c88-4bb7-b16b-8e4b442548ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.872500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f1aa-4c88-4bb7-b16b-8e4b442548ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.874175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20f1aa-4c88-4bb7-b16b-8e4b442548ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:08.875882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20f1aa-4c88-4bb7-b16b-8e4b442548ba admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:08.905579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1184/2351] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:10:08.908195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1421a2-fc74-44e4-b335-e6c7ef46bda6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:08.920679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1421a2-fc74-44e4-b335-e6c7ef46bda6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:08.927046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd66465-27d2-46d0-b5fb-e367cf5500e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:08.927669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66465-27d2-46d0-b5fb-e367cf5500e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.927937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66465-27d2-46d0-b5fb-e367cf5500e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.928207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66465-27d2-46d0-b5fb-e367cf5500e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.928934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd66465-27d2-46d0-b5fb-e367cf5500e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:08.930683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd66465-27d2-46d0-b5fb-e367cf5500e6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:08.946927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1168/2352] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:08.948701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f1aa-4c88-4bb7-b16b-8e4b442548ba admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:08.965780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f1aa-4c88-4bb7-b16b-8e4b442548ba admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:08.974487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ed1f-4028-47dd-96c5-d6768d4a2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:08.975181 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ed1f-4028-47dd-96c5-d6768d4a2066 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:08.975465 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ed1f-4028-47dd-96c5-d6768d4a2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:08.975741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ed1f-4028-47dd-96c5-d6768d4a2066 admin admin] PATH_INFO: `/v3/projects/6f6768bd663c4c44b238eedc3250f3e3/users/a4133346a8284fb5b21fc46fed9edb24/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:08.995399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:08.999547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8ed1f-4028-47dd-96c5-d6768d4a2066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6768bd663c4c44b238eedc3250f3e3, user_id=a4133346a8284fb5b21fc46fed9edb24, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:09.002646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8ed1f-4028-47dd-96c5-d6768d4a2066 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:09.041678 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1185/2353] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:08 2022] PUT /identity/v3/projects/6f6768bd663c4c44b238eedc3250f3e3/users/a4133346a8284fb5b21fc46fed9edb24/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:09.041947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaf5f-3ac7-46d3-a9b9-9881164d715f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.042069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaf5f-3ac7-46d3-a9b9-9881164d715f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.042509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaf5f-3ac7-46d3-a9b9-9881164d715f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.094627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-75aaaf5f-3ac7-46d3-a9b9-9881164d715f None None] MFA Rules not processed for user `a4133346a8284fb5b21fc46fed9edb24`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:09.095873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-75aaaf5f-3ac7-46d3-a9b9-9881164d715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:09.227683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ed1f-4028-47dd-96c5-d6768d4a2066 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:09.229615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7de8ed1f-4028-47dd-96c5-d6768d4a2066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:09.274175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1169/2354] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:09.275070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaaf5f-3ac7-46d3-a9b9-9881164d715f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:09.371850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaaf5f-3ac7-46d3-a9b9-9881164d715f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:09.376855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc6870-bc91-4acf-9d28-ca44c7fe99f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:09.377477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc6870-bc91-4acf-9d28-ca44c7fe99f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.377758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc6870-bc91-4acf-9d28-ca44c7fe99f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.378739 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc6870-bc91-4acf-9d28-ca44c7fe99f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.379008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ed1f-4028-47dd-96c5-d6768d4a2066 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:09.379390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc6870-bc91-4acf-9d28-ca44c7fe99f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:09.381336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc6870-bc91-4acf-9d28-ca44c7fe99f0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:09.384313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:09.384998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.385267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.385554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] PATH_INFO: `/v3/projects/9510b7cfa13b48acb6b5b12356e9aecd` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.390449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9510b7cfa13b48acb6b5b12356e9aecd)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:09.394822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:09.418841 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1170/2355] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:09 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:09.420115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc6870-bc91-4acf-9d28-ca44c7fe99f0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:09.465753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9510b7cfa13b48acb6b5b12356e9aecd', 'request_id': 'req-c5bf4a54-c187-4b3a-bee0-21fbae68db12'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:09.471995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:09.474381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9510b7cfa13b48acb6b5b12356e9aecd', 'request_id': 'req-c5bf4a54-c187-4b3a-bee0-21fbae68db12'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:09.484857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9510b7cfa13b48acb6b5b12356e9aecd', 'request_id': 'req-c5bf4a54-c187-4b3a-bee0-21fbae68db12'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:09.497325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc6870-bc91-4acf-9d28-ca44c7fe99f0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:09.506151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] The token cache is being invalidate because project 9510b7cfa13b48acb6b5b12356e9aecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:09.506151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:09.507016 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c5bf4a54-c187-4b3a-bee0-21fbae68db12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:09.511158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1186/2356] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:09 2022] DELETE /identity/v3/projects/9510b7cfa13b48acb6b5b12356e9aecd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:10:09.517104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b30d34-ac17-40a0-a47d-e2da3e194283 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.517339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b30d34-ac17-40a0-a47d-e2da3e194283 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.517621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b30d34-ac17-40a0-a47d-e2da3e194283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.552744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c2b30d34-ac17-40a0-a47d-e2da3e194283 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:09.554474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c2b30d34-ac17-40a0-a47d-e2da3e194283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:09.660931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429166f-5239-4d2b-b8a9-211a9a17605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:09.661540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1187/2357] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:09.662130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429166f-5239-4d2b-b8a9-211a9a17605f admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.662419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429166f-5239-4d2b-b8a9-211a9a17605f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.662698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429166f-5239-4d2b-b8a9-211a9a17605f admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.663344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429166f-5239-4d2b-b8a9-211a9a17605f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:09.665508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429166f-5239-4d2b-b8a9-211a9a17605f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:09.669216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f34bb-3096-4738-ae7e-d3643f02cd6c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.669772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f34bb-3096-4738-ae7e-d3643f02cd6c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.670267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f34bb-3096-4738-ae7e-d3643f02cd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.694692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6f8f34bb-3096-4738-ae7e-d3643f02cd6c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:09.696499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6f8f34bb-3096-4738-ae7e-d3643f02cd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:09.699697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1171/2358] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:09 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:10:09.703711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429166f-5239-4d2b-b8a9-211a9a17605f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:09.705622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5429166f-5239-4d2b-b8a9-211a9a17605f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:09.707818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1188/2359] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:09.712002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f34bb-3096-4738-ae7e-d3643f02cd6c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:09.720638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429166f-5239-4d2b-b8a9-211a9a17605f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:09.726461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c51c03-9107-4555-90c6-05e1214220ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:09.727086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c51c03-9107-4555-90c6-05e1214220ed admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.727222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f34bb-3096-4738-ae7e-d3643f02cd6c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:09.727428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c51c03-9107-4555-90c6-05e1214220ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.727643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c51c03-9107-4555-90c6-05e1214220ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.728848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c51c03-9107-4555-90c6-05e1214220ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:09.730505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c51c03-9107-4555-90c6-05e1214220ed admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:09.732397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f54f5-ce95-4c7e-a3e2-d16d20b9443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:09.733010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f54f5-ce95-4c7e-a3e2-d16d20b9443d admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.733295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f54f5-ce95-4c7e-a3e2-d16d20b9443d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.733571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f54f5-ce95-4c7e-a3e2-d16d20b9443d admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.734230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f54f5-ce95-4c7e-a3e2-d16d20b9443d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:10:09.734539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f54f5-ce95-4c7e-a3e2-d16d20b9443d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:09.736127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f54f5-ce95-4c7e-a3e2-d16d20b9443d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:09.759130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1172/2360] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:10:09.759314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1189/2361] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:10:09.759421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c51c03-9107-4555-90c6-05e1214220ed admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:09.760128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f54f5-ce95-4c7e-a3e2-d16d20b9443d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:09.770383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:09.780417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c51c03-9107-4555-90c6-05e1214220ed admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:09.782998 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f54f5-ce95-4c7e-a3e2-d16d20b9443d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:09.791296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cce1c-a9af-4d81-9cd4-522c5ffd255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:09.792195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cce1c-a9af-4d81-9cd4-522c5ffd255e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.792195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cce1c-a9af-4d81-9cd4-522c5ffd255e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.792195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cce1c-a9af-4d81-9cd4-522c5ffd255e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.792607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cce1c-a9af-4d81-9cd4-522c5ffd255e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:09.795129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cce1c-a9af-4d81-9cd4-522c5ffd255e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:09.797624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a46758-954b-42ed-93d9-4f99b5fbac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:09.798257 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a46758-954b-42ed-93d9-4f99b5fbac7d admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.798542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a46758-954b-42ed-93d9-4f99b5fbac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.798823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a46758-954b-42ed-93d9-4f99b5fbac7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.799474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a46758-954b-42ed-93d9-4f99b5fbac7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:09.802929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a46758-954b-42ed-93d9-4f99b5fbac7d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:09.810254 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1173/2362] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:10:09.811350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cce1c-a9af-4d81-9cd4-522c5ffd255e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:09.826100 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cce1c-a9af-4d81-9cd4-522c5ffd255e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:09.842347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde8d71-573d-4864-955a-19c594dac265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:09.843019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8d71-573d-4864-955a-19c594dac265 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.843302 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8d71-573d-4864-955a-19c594dac265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.843580 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8d71-573d-4864-955a-19c594dac265 admin admin] PATH_INFO: `/v3/projects/cb019dabb1cf431fbd12326b58238880/users/2fc5bca0a57347b2bd65a431d6841f93/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.868828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1190/2363] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:09 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:09.874148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a46758-954b-42ed-93d9-4f99b5fbac7d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:09.882287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde8d71-573d-4864-955a-19c594dac265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb019dabb1cf431fbd12326b58238880, user_id=2fc5bca0a57347b2bd65a431d6841f93, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:09.885700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde8d71-573d-4864-955a-19c594dac265 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:09.916276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1174/2364] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:09 2022] PUT /identity/v3/projects/cb019dabb1cf431fbd12326b58238880/users/2fc5bca0a57347b2bd65a431d6841f93/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:10:09.929014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053fba1-d4c0-4375-9ea4-b914953b701c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:09.929368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053fba1-d4c0-4375-9ea4-b914953b701c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:09.929709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053fba1-d4c0-4375-9ea4-b914953b701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:09.998455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e053fba1-d4c0-4375-9ea4-b914953b701c None None] MFA Rules not processed for user `2fc5bca0a57347b2bd65a431d6841f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:09.999836 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e053fba1-d4c0-4375-9ea4-b914953b701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:10.048825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a46758-954b-42ed-93d9-4f99b5fbac7d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:10.165708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd8c6-c11b-4782-9d41-4c4f8730ec58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:10.171947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd8c6-c11b-4782-9d41-4c4f8730ec58 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:10.172729 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd8c6-c11b-4782-9d41-4c4f8730ec58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:10.177546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd8c6-c11b-4782-9d41-4c4f8730ec58 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:10.179739 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dd8c6-c11b-4782-9d41-4c4f8730ec58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:10.183681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dd8c6-c11b-4782-9d41-4c4f8730ec58 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:10.210688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1175/2365] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:10.215426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053fba1-d4c0-4375-9ea4-b914953b701c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:10.234527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053fba1-d4c0-4375-9ea4-b914953b701c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:10.247280 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1191/2366] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:09 2022] POST /identity/v3/users => generated 282 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:10:10.251138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd8c6-c11b-4782-9d41-4c4f8730ec58 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:10.253841 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06e795-0a88-47e7-8fa5-7ce562a8f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:10.254605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06e795-0a88-47e7-8fa5-7ce562a8f280 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:10.254962 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06e795-0a88-47e7-8fa5-7ce562a8f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:10.255311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06e795-0a88-47e7-8fa5-7ce562a8f280 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:10.256019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06e795-0a88-47e7-8fa5-7ce562a8f280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:10.260564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06e795-0a88-47e7-8fa5-7ce562a8f280 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:10.275038 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd8c6-c11b-4782-9d41-4c4f8730ec58 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:10.289397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a83d3c-7d5e-4711-9865-807973f713a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:10.290138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83d3c-7d5e-4711-9865-807973f713a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:10.290430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83d3c-7d5e-4711-9865-807973f713a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:10.290764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83d3c-7d5e-4711-9865-807973f713a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:10.291432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a83d3c-7d5e-4711-9865-807973f713a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:10.293154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a83d3c-7d5e-4711-9865-807973f713a4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:10.308729 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:10.322360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1192/2367] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:10.323871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a83d3c-7d5e-4711-9865-807973f713a4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:10.342256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1176/2368] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:10 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:10:10.344953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06e795-0a88-47e7-8fa5-7ce562a8f280 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:10.355101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a83d3c-7d5e-4711-9865-807973f713a4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:10.507049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06e795-0a88-47e7-8fa5-7ce562a8f280 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:10.507925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c43e4-e7fc-4eae-aa82-37b086d1f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:10.509127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c43e4-e7fc-4eae-aa82-37b086d1f9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:10.509412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c43e4-e7fc-4eae-aa82-37b086d1f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:10.509683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c43e4-e7fc-4eae-aa82-37b086d1f9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:10.510594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c43e4-e7fc-4eae-aa82-37b086d1f9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:10.513261 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c43e4-e7fc-4eae-aa82-37b086d1f9cd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:10.521745 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ae99d-95e2-4382-8db4-6ad78b9aff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:10.522803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ae99d-95e2-4382-8db4-6ad78b9aff51 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:10.523094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ae99d-95e2-4382-8db4-6ad78b9aff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:10.523387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ae99d-95e2-4382-8db4-6ad78b9aff51 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:10.524011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ae99d-95e2-4382-8db4-6ad78b9aff51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:10.530948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ae99d-95e2-4382-8db4-6ad78b9aff51 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:10.543104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1193/2369] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:10.545582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c43e4-e7fc-4eae-aa82-37b086d1f9cd admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:10.568719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:10.589075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c43e4-e7fc-4eae-aa82-37b086d1f9cd admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:10.589248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1177/2370] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:10 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:10.592934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ae99d-95e2-4382-8db4-6ad78b9aff51 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:10.603108 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408bf30-14ce-4f6a-83eb-91e3a96f3015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:10.603810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bf30-14ce-4f6a-83eb-91e3a96f3015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:10.604078 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bf30-14ce-4f6a-83eb-91e3a96f3015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:10.604766 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ae99d-95e2-4382-8db4-6ad78b9aff51 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:10.605644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bf30-14ce-4f6a-83eb-91e3a96f3015 admin admin] PATH_INFO: `/v3/projects/b7c3f527fae4424ba6b6ffc0bb09f8a5/users/d489d4138723436c897518a3bb273cbf/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:10.610271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6db33-b758-4564-8bb0-63bbc87d56c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:10.610889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6db33-b758-4564-8bb0-63bbc87d56c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:10.611319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6db33-b758-4564-8bb0-63bbc87d56c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:10.611612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6db33-b758-4564-8bb0-63bbc87d56c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:10.612989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6db33-b758-4564-8bb0-63bbc87d56c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:10.615135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6db33-b758-4564-8bb0-63bbc87d56c3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:10.631228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1178/2371] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:10:10.636779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6db33-b758-4564-8bb0-63bbc87d56c3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:10.640515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408bf30-14ce-4f6a-83eb-91e3a96f3015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c3f527fae4424ba6b6ffc0bb09f8a5, user_id=d489d4138723436c897518a3bb273cbf, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:10.646724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408bf30-14ce-4f6a-83eb-91e3a96f3015 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:10.659656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6db33-b758-4564-8bb0-63bbc87d56c3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:10.672139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1194/2372] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:10 2022] PUT /identity/v3/projects/b7c3f527fae4424ba6b6ffc0bb09f8a5/users/d489d4138723436c897518a3bb273cbf/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:10.673020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44918f17-dc9d-4129-be6a-2e8a61972612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:10.673580 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44918f17-dc9d-4129-be6a-2e8a61972612 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:10.673865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44918f17-dc9d-4129-be6a-2e8a61972612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:10.674146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44918f17-dc9d-4129-be6a-2e8a61972612 admin admin] PATH_INFO: `/v3/projects/93ba54ddf32d4fbe9a4bcb1cc473df50/users/d5ae995705654dcca9de91e302cc419c/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:10.682930 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72b1bd-a147-4da1-b651-6118e530f776 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:10.683242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72b1bd-a147-4da1-b651-6118e530f776 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:10.683482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72b1bd-a147-4da1-b651-6118e530f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:10.710552 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44918f17-dc9d-4129-be6a-2e8a61972612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ba54ddf32d4fbe9a4bcb1cc473df50, user_id=d5ae995705654dcca9de91e302cc419c, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:10.714082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44918f17-dc9d-4129-be6a-2e8a61972612 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:10.744784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6f72b1bd-a147-4da1-b651-6118e530f776 None None] MFA Rules not processed for user `d489d4138723436c897518a3bb273cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:10.746304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6f72b1bd-a147-4da1-b651-6118e530f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:10.782413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1179/2373] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:10 2022] PUT /identity/v3/projects/93ba54ddf32d4fbe9a4bcb1cc473df50/users/d5ae995705654dcca9de91e302cc419c/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:10.783579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44918f17-dc9d-4129-be6a-2e8a61972612 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:10.914614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1195/2374] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:10.924266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44918f17-dc9d-4129-be6a-2e8a61972612 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:10.929778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72b1bd-a147-4da1-b651-6118e530f776 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:10.933547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6f72b1bd-a147-4da1-b651-6118e530f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:10.942810 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495d823-910d-47c9-b54b-d20596d474f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:10.944918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495d823-910d-47c9-b54b-d20596d474f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:10.945207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495d823-910d-47c9-b54b-d20596d474f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:10.945488 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495d823-910d-47c9-b54b-d20596d474f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:10.946151 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495d823-910d-47c9-b54b-d20596d474f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:10.953661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495d823-910d-47c9-b54b-d20596d474f0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:10.997500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1180/2375] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:10.999825 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495d823-910d-47c9-b54b-d20596d474f0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:11.041412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495d823-910d-47c9-b54b-d20596d474f0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:11.064531 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec7e2e-2f1d-49c8-b532-d16ef730b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:11.065105 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec7e2e-2f1d-49c8-b532-d16ef730b2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:11.065933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec7e2e-2f1d-49c8-b532-d16ef730b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:11.066274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec7e2e-2f1d-49c8-b532-d16ef730b2d2 admin admin] PATH_INFO: `/v3/projects/93ba54ddf32d4fbe9a4bcb1cc473df50/users/d5ae995705654dcca9de91e302cc419c/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:11.068872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec7e2e-2f1d-49c8-b532-d16ef730b2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ba54ddf32d4fbe9a4bcb1cc473df50, user_id=d5ae995705654dcca9de91e302cc419c, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:11.072410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec7e2e-2f1d-49c8-b532-d16ef730b2d2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:11.101258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1181/2376] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:10 2022] PUT /identity/v3/projects/93ba54ddf32d4fbe9a4bcb1cc473df50/users/d5ae995705654dcca9de91e302cc419c/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:11.103135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb1ade-64a2-46e1-80bf-d8fa9a714e7e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:11.103533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb1ade-64a2-46e1-80bf-d8fa9a714e7e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:11.103915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb1ade-64a2-46e1-80bf-d8fa9a714e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:11.166017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72b1bd-a147-4da1-b651-6118e530f776 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:11.199854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1afb1ade-64a2-46e1-80bf-d8fa9a714e7e None None] MFA Rules not processed for user `d5ae995705654dcca9de91e302cc419c`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:11.201473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1afb1ade-64a2-46e1-80bf-d8fa9a714e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:11.245030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03a74-6864-4945-bdd8-e2fb752fc919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:11.245814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03a74-6864-4945-bdd8-e2fb752fc919 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:11.246092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03a74-6864-4945-bdd8-e2fb752fc919 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:11.246532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03a74-6864-4945-bdd8-e2fb752fc919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:11.281749 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:11.375414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1182/2377] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:11.376802 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb1ade-64a2-46e1-80bf-d8fa9a714e7e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:11.379332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1afb1ade-64a2-46e1-80bf-d8fa9a714e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:11.382436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:11.433914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa03a74-6864-4945-bdd8-e2fb752fc919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:11.435402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa03a74-6864-4945-bdd8-e2fb752fc919 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:11.462448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1196/2378] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:11.464666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03a74-6864-4945-bdd8-e2fb752fc919 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:11.467919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5aa03a74-6864-4945-bdd8-e2fb752fc919 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:11.496467 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03a74-6864-4945-bdd8-e2fb752fc919 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:11.508220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb1ade-64a2-46e1-80bf-d8fa9a714e7e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:11.511405 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75269ad1-a046-4f1a-8a21-b2739e817f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:11.512445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75269ad1-a046-4f1a-8a21-b2739e817f73 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:11.513134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75269ad1-a046-4f1a-8a21-b2739e817f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:11.514410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75269ad1-a046-4f1a-8a21-b2739e817f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:11.518208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-75269ad1-a046-4f1a-8a21-b2739e817f73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:11.521837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:11.523890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:11.524820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:11.526509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] PATH_INFO: `/v3/users/dc9f7a90f6fb49ca92ce004e315ee067` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:11.530153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9f7a90f6fb49ca92ce004e315ee067)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:11.540554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:11.631659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9f7a90f6fb49ca92ce004e315ee067'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:11.632526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9f7a90f6fb49ca92ce004e315ee067'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:11.641669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75269ad1-a046-4f1a-8a21-b2739e817f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:11.643119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75269ad1-a046-4f1a-8a21-b2739e817f73 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:11.644270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9f7a90f6fb49ca92ce004e315ee067'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:11.655608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1197/2379] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:11.693814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9f7a90f6fb49ca92ce004e315ee067'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:11.714778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9f7a90f6fb49ca92ce004e315ee067'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:11.744418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1183/2380] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:11 2022] DELETE /identity/v3/users/dc9f7a90f6fb49ca92ce004e315ee067 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:11.746262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6a540-e45d-4637-9d69-c6f3705f0d3c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:11.746564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6a540-e45d-4637-9d69-c6f3705f0d3c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:11.746853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6a540-e45d-4637-9d69-c6f3705f0d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:11.780734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-32d6a540-e45d-4637-9d69-c6f3705f0d3c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:11.797262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-32d6a540-e45d-4637-9d69-c6f3705f0d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:11.962867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1198/2381] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:11.974646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:11.976310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:12.137903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:12.182636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648e750-016c-4fc0-a39a-d2bf4d8b8b4f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:12.191399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a71b27-a3e8-435a-a835-5af8eca0e532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:12.192104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71b27-a3e8-435a-a835-5af8eca0e532 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:12.192434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71b27-a3e8-435a-a835-5af8eca0e532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:12.193031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71b27-a3e8-435a-a835-5af8eca0e532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:12.223337 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a71b27-a3e8-435a-a835-5af8eca0e532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:12.224837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a71b27-a3e8-435a-a835-5af8eca0e532 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:12.258688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1184/2382] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:13.111464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6a540-e45d-4637-9d69-c6f3705f0d3c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:13.114111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-32d6a540-e45d-4637-9d69-c6f3705f0d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:13.129465 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6a540-e45d-4637-9d69-c6f3705f0d3c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:13.143923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:13.145490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:13.146013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:13.146702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] PATH_INFO: `/v3/projects/437da6457aa540bd94a0e3ad8fc4c087` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:13.148264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=437da6457aa540bd94a0e3ad8fc4c087)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:13.150601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:13.240753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437da6457aa540bd94a0e3ad8fc4c087', 'request_id': 'req-3d4b0872-a4b8-4d22-a469-633815c9c0bd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:13.247711 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437da6457aa540bd94a0e3ad8fc4c087', 'request_id': 'req-3d4b0872-a4b8-4d22-a469-633815c9c0bd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:13.264109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437da6457aa540bd94a0e3ad8fc4c087', 'request_id': 'req-3d4b0872-a4b8-4d22-a469-633815c9c0bd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:13.275434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:13.282931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] The token cache is being invalidate because project 437da6457aa540bd94a0e3ad8fc4c087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:13.283756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:13.285612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:13.287589 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1199/2383] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:13 2022] DELETE /identity/v3/projects/437da6457aa540bd94a0e3ad8fc4c087 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:13.292184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a71b27-a3e8-435a-a835-5af8eca0e532 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:13.305727 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a71b27-a3e8-435a-a835-5af8eca0e532 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:13.422912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:13.424577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:13.425744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:13.426315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] PATH_INFO: `/v3/users/31275ac2f5044b9c921d1d8ed8771e75` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:13.430859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=31275ac2f5044b9c921d1d8ed8771e75)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:13.433333 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:13.553448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31275ac2f5044b9c921d1d8ed8771e75'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:13.554225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31275ac2f5044b9c921d1d8ed8771e75'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:13.566329 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31275ac2f5044b9c921d1d8ed8771e75'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:13.602107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31275ac2f5044b9c921d1d8ed8771e75'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:13.619922 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31275ac2f5044b9c921d1d8ed8771e75'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:13.635543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1185/2384] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:13 2022] DELETE /identity/v3/users/31275ac2f5044b9c921d1d8ed8771e75 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:13.853918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:13.855522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:14.135986 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b0872-a4b8-4d22-a469-633815c9c0bd admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:14.370942 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:14.372472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:14.629803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13bebf-75a2-4d84-91f4-24593a4634fe admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:14.634918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:14.635848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:14.636133 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:14.636439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] PATH_INFO: `/v3/projects/3aa1e75f23744f3ea9976bf4ff0c77ce` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:14.639114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa1e75f23744f3ea9976bf4ff0c77ce)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:14.641688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:14.646033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:14.734543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd5fb4-f082-499b-bc6a-58242b0e5421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:14.735611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd5fb4-f082-499b-bc6a-58242b0e5421 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:14.735996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd5fb4-f082-499b-bc6a-58242b0e5421 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:14.738529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd5fb4-f082-499b-bc6a-58242b0e5421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:14.739571 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa1e75f23744f3ea9976bf4ff0c77ce', 'request_id': 'req-5e85e902-fa3d-4292-bf78-7fa73a8893f1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:14.740764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-39fd5fb4-f082-499b-bc6a-58242b0e5421 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:14.752174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa1e75f23744f3ea9976bf4ff0c77ce', 'request_id': 'req-5e85e902-fa3d-4292-bf78-7fa73a8893f1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:14.763218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa1e75f23744f3ea9976bf4ff0c77ce', 'request_id': 'req-5e85e902-fa3d-4292-bf78-7fa73a8893f1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:14.778512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] The token cache is being invalidate because project 3aa1e75f23744f3ea9976bf4ff0c77ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:14.778962 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:14.779734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5e85e902-fa3d-4292-bf78-7fa73a8893f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:14.781758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1186/2385] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:14 2022] DELETE /identity/v3/projects/3aa1e75f23744f3ea9976bf4ff0c77ce => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:14.786697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45294c9a-6b9c-4aee-93cc-2ebed0e3f242 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:14.787121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45294c9a-6b9c-4aee-93cc-2ebed0e3f242 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:14.787497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45294c9a-6b9c-4aee-93cc-2ebed0e3f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:14.813700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-45294c9a-6b9c-4aee-93cc-2ebed0e3f242 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:14.817699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-45294c9a-6b9c-4aee-93cc-2ebed0e3f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:14.854624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd5fb4-f082-499b-bc6a-58242b0e5421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:14.856388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd5fb4-f082-499b-bc6a-58242b0e5421 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:14.868836 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1200/2386] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1016 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:14.928879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1187/2387] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:10:14.939322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200731b-a645-43bb-a9c7-be4ad789bd3c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:14.939643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200731b-a645-43bb-a9c7-be4ad789bd3c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:14.939926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200731b-a645-43bb-a9c7-be4ad789bd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:14.987445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6200731b-a645-43bb-a9c7-be4ad789bd3c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:14.988883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6200731b-a645-43bb-a9c7-be4ad789bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:15.004123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1201/2388] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:15.005004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45294c9a-6b9c-4aee-93cc-2ebed0e3f242 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:15.030677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45294c9a-6b9c-4aee-93cc-2ebed0e3f242 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:15.040803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22001573-2d88-49e0-b13c-c4a88dc1bab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:15.041647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001573-2d88-49e0-b13c-c4a88dc1bab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:15.041938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001573-2d88-49e0-b13c-c4a88dc1bab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:15.043345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001573-2d88-49e0-b13c-c4a88dc1bab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:15.046366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22001573-2d88-49e0-b13c-c4a88dc1bab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:10:15.046974 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22001573-2d88-49e0-b13c-c4a88dc1bab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:15.053175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22001573-2d88-49e0-b13c-c4a88dc1bab0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:15.085691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1188/2389] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:10:15.086598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200731b-a645-43bb-a9c7-be4ad789bd3c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:15.104530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200731b-a645-43bb-a9c7-be4ad789bd3c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:15.124416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6f800-60ea-41ce-8a08-1db2ccc8c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:15.125127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6f800-60ea-41ce-8a08-1db2ccc8c11e admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:15.125651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6f800-60ea-41ce-8a08-1db2ccc8c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:15.126172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6f800-60ea-41ce-8a08-1db2ccc8c11e admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:15.127128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6f800-60ea-41ce-8a08-1db2ccc8c11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:15.132088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6f800-60ea-41ce-8a08-1db2ccc8c11e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:15.183753 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1202/2390] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:15 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:10:15.184978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22001573-2d88-49e0-b13c-c4a88dc1bab0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:15.197998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22001573-2d88-49e0-b13c-c4a88dc1bab0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:15.289509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094ca3b-7c2a-43d2-ae50-b425662054c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:15.290496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094ca3b-7c2a-43d2-ae50-b425662054c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:15.291067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094ca3b-7c2a-43d2-ae50-b425662054c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:15.291576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094ca3b-7c2a-43d2-ae50-b425662054c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:15.292466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094ca3b-7c2a-43d2-ae50-b425662054c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:15.294761 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094ca3b-7c2a-43d2-ae50-b425662054c6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:15.325520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1189/2391] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:15 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:10:15.329777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6f800-60ea-41ce-8a08-1db2ccc8c11e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:15.345544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6f800-60ea-41ce-8a08-1db2ccc8c11e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:15.364397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fe598-ea52-4dca-8cb1-72337f2a545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:15.365032 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fe598-ea52-4dca-8cb1-72337f2a545c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:15.365396 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fe598-ea52-4dca-8cb1-72337f2a545c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:15.366128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fe598-ea52-4dca-8cb1-72337f2a545c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:15.366598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fe598-ea52-4dca-8cb1-72337f2a545c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:15.367962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fe598-ea52-4dca-8cb1-72337f2a545c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:15.383050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1203/2392] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:15.386969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094ca3b-7c2a-43d2-ae50-b425662054c6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:15.408143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094ca3b-7c2a-43d2-ae50-b425662054c6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:15.417569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85261166-24d2-4d80-8b17-37a3b0608196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:15.419330 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85261166-24d2-4d80-8b17-37a3b0608196 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:15.419853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85261166-24d2-4d80-8b17-37a3b0608196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:15.420342 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85261166-24d2-4d80-8b17-37a3b0608196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:15.422180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85261166-24d2-4d80-8b17-37a3b0608196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:15.424223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85261166-24d2-4d80-8b17-37a3b0608196 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:15.429064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:15.446515 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1190/2393] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:15.447344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fe598-ea52-4dca-8cb1-72337f2a545c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:15.464371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fe598-ea52-4dca-8cb1-72337f2a545c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:15.481252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1da8-3797-4980-8804-fd2b3db3a9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:15.481972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1da8-3797-4980-8804-fd2b3db3a9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:15.482248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1da8-3797-4980-8804-fd2b3db3a9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:15.482530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1da8-3797-4980-8804-fd2b3db3a9a7 admin admin] PATH_INFO: `/v3/projects/2cdb7abc108e4867864bd4568b4fc6fe/users/fc69edf9dd064d45b91c0ee7adfba583/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:15.528686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf1da8-3797-4980-8804-fd2b3db3a9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cdb7abc108e4867864bd4568b4fc6fe, user_id=fc69edf9dd064d45b91c0ee7adfba583, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:15.532365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf1da8-3797-4980-8804-fd2b3db3a9a7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:15.576785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1204/2394] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:15 2022] PUT /identity/v3/projects/2cdb7abc108e4867864bd4568b4fc6fe/users/fc69edf9dd064d45b91c0ee7adfba583/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:15.588928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb1a41-f7d5-47b3-b134-e368e7a702b7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:15.589294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb1a41-f7d5-47b3-b134-e368e7a702b7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:15.589577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb1a41-f7d5-47b3-b134-e368e7a702b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:15.663602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-89bb1a41-f7d5-47b3-b134-e368e7a702b7 None None] MFA Rules not processed for user `fc69edf9dd064d45b91c0ee7adfba583`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:15.665123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-89bb1a41-f7d5-47b3-b134-e368e7a702b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:15.841405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1191/2395] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:15.861969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1da8-3797-4980-8804-fd2b3db3a9a7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:15.864354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4abf1da8-3797-4980-8804-fd2b3db3a9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:15.890286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:15.929854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb1a41-f7d5-47b3-b134-e368e7a702b7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:15.931395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-89bb1a41-f7d5-47b3-b134-e368e7a702b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:16.004994 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1da8-3797-4980-8804-fd2b3db3a9a7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:16.011050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692dc45-3334-486b-99f4-0c21502773c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb70dd34dc642cfbb49b4e1a0434399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:16.011849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692dc45-3334-486b-99f4-0c21502773c7 service glance] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:16.012225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692dc45-3334-486b-99f4-0c21502773c7 service glance] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:16.013166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692dc45-3334-486b-99f4-0c21502773c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:16.025793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692dc45-3334-486b-99f4-0c21502773c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:16.027627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692dc45-3334-486b-99f4-0c21502773c7 service glance] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:16.053611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1205/2396] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:16.056414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb1a41-f7d5-47b3-b134-e368e7a702b7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:16.069706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0e38e-2c3f-4ef5-9668-0a84347a4709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:16.070341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e38e-2c3f-4ef5-9668-0a84347a4709 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:16.070625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e38e-2c3f-4ef5-9668-0a84347a4709 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:16.071028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e38e-2c3f-4ef5-9668-0a84347a4709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:16.080606 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-85c0e38e-2c3f-4ef5-9668-0a84347a4709 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:16.210241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0e38e-2c3f-4ef5-9668-0a84347a4709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:16.212021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0e38e-2c3f-4ef5-9668-0a84347a4709 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:16.226692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1192/2397] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:19.653734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a286ad1-7958-4be7-8f32-0413ef3964b5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:19.654869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a286ad1-7958-4be7-8f32-0413ef3964b5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:19.655412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a286ad1-7958-4be7-8f32-0413ef3964b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:19.681150 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5a286ad1-7958-4be7-8f32-0413ef3964b5 None None] MFA Rules not processed for user `e01d1012d66b46b0806c9b77bfd161a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:19.683925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5a286ad1-7958-4be7-8f32-0413ef3964b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:19.808558 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1206/2398] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:20.505018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0e38e-2c3f-4ef5-9668-0a84347a4709 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:20.506619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-85c0e38e-2c3f-4ef5-9668-0a84347a4709 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:20.558853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:20.588586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0e38e-2c3f-4ef5-9668-0a84347a4709 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:20.595624 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:20.597090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:20.597483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:20.597919 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] PATH_INFO: `/v3/users/a4133346a8284fb5b21fc46fed9edb24` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:20.599181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4133346a8284fb5b21fc46fed9edb24)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:20.601331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:20.663659 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4133346a8284fb5b21fc46fed9edb24'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:20.664388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4133346a8284fb5b21fc46fed9edb24'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:20.673070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4133346a8284fb5b21fc46fed9edb24'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:20.691512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4133346a8284fb5b21fc46fed9edb24'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:20.707187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4133346a8284fb5b21fc46fed9edb24'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:20.716532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1193/2399] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:20 2022] DELETE /identity/v3/users/a4133346a8284fb5b21fc46fed9edb24 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:20.718479 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a01ed-4e60-4ec1-b7e4-dd9ca46600c9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:20.718954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a01ed-4e60-4ec1-b7e4-dd9ca46600c9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:20.719059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a01ed-4e60-4ec1-b7e4-dd9ca46600c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:20.747095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-577a01ed-4e60-4ec1-b7e4-dd9ca46600c9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:20.749010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-577a01ed-4e60-4ec1-b7e4-dd9ca46600c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:20.822521 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1207/2400] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:20.837406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:20.839065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:20.926060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea7a1-451c-4e76-8774-f28953dd6030 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:20.935412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c075b-1988-4709-8fc7-45b652a85f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:20.936156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c075b-1988-4709-8fc7-45b652a85f3d service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:20.936543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c075b-1988-4709-8fc7-45b652a85f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:20.936898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c075b-1988-4709-8fc7-45b652a85f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:20.948032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c075b-1988-4709-8fc7-45b652a85f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:20.951484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c075b-1988-4709-8fc7-45b652a85f3d service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:20.964264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1194/2401] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:21.329642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a01ed-4e60-4ec1-b7e4-dd9ca46600c9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:21.332146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-577a01ed-4e60-4ec1-b7e4-dd9ca46600c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:21.366828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a01ed-4e60-4ec1-b7e4-dd9ca46600c9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:21.387084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:21.388394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:21.389136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:21.389660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] PATH_INFO: `/v3/projects/6f6768bd663c4c44b238eedc3250f3e3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:21.393449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6768bd663c4c44b238eedc3250f3e3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:21.395848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:21.483612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6768bd663c4c44b238eedc3250f3e3', 'request_id': 'req-48f03f36-ce40-470c-8ac1-39656696c093'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:21.485125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:21.493314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6768bd663c4c44b238eedc3250f3e3', 'request_id': 'req-48f03f36-ce40-470c-8ac1-39656696c093'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:21.504968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6768bd663c4c44b238eedc3250f3e3', 'request_id': 'req-48f03f36-ce40-470c-8ac1-39656696c093'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:21.535044 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] The token cache is being invalidate because project 6f6768bd663c4c44b238eedc3250f3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:21.535347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:21.536128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:21.537973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1208/2402] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:21 2022] DELETE /identity/v3/projects/6f6768bd663c4c44b238eedc3250f3e3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:21.541773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c075b-1988-4709-8fc7-45b652a85f3d service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:21.554527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c075b-1988-4709-8fc7-45b652a85f3d service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:21.627260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:21.627958 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:21.628239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:21.628537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] PATH_INFO: `/v3/users/2fc5bca0a57347b2bd65a431d6841f93` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:21.629782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc5bca0a57347b2bd65a431d6841f93)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:21.631999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:21.657272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:21.792456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc5bca0a57347b2bd65a431d6841f93'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:21.792456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc5bca0a57347b2bd65a431d6841f93'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:21.809655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc5bca0a57347b2bd65a431d6841f93'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:21.833022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc5bca0a57347b2bd65a431d6841f93'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:21.854809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc5bca0a57347b2bd65a431d6841f93'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:21.862996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1195/2403] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:21 2022] DELETE /identity/v3/users/2fc5bca0a57347b2bd65a431d6841f93 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:22.367978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:22.369601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:22.389873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f03f36-ce40-470c-8ac1-39656696c093 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:22.459892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:22.460602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:22.460881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:22.461150 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] PATH_INFO: `/v3/projects/cb019dabb1cf431fbd12326b58238880` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:22.467569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb019dabb1cf431fbd12326b58238880)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:22.467569 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:22.527679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb019dabb1cf431fbd12326b58238880', 'request_id': 'req-f07c8df7-9ea0-4a19-943a-32c1de21804c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:22.533951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb019dabb1cf431fbd12326b58238880', 'request_id': 'req-f07c8df7-9ea0-4a19-943a-32c1de21804c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:22.542635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb019dabb1cf431fbd12326b58238880', 'request_id': 'req-f07c8df7-9ea0-4a19-943a-32c1de21804c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:22.556276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] The token cache is being invalidate because project cb019dabb1cf431fbd12326b58238880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:22.556662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:22.557470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f07c8df7-9ea0-4a19-943a-32c1de21804c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:22.559295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1209/2404] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:22 2022] DELETE /identity/v3/projects/cb019dabb1cf431fbd12326b58238880 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:22.563395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:22.565843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:22.582594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6846fac-d54f-44a8-b7c6-371183a09142 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:22.644741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:22.645538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:22.645924 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:22.646309 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] PATH_INFO: `/v3/users/d5ae995705654dcca9de91e302cc419c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:22.647583 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ae995705654dcca9de91e302cc419c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:22.649819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:22.707281 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ae995705654dcca9de91e302cc419c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:22.707994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ae995705654dcca9de91e302cc419c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:22.711112 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83768f1-7c1d-462a-a9db-fd8922e97abf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:22.711397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83768f1-7c1d-462a-a9db-fd8922e97abf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:22.711671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83768f1-7c1d-462a-a9db-fd8922e97abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:22.717976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ae995705654dcca9de91e302cc419c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:22.733272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d83768f1-7c1d-462a-a9db-fd8922e97abf None None] MFA Rules not processed for user `94de55a6079d433284ae27c837dad550`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:22.734504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d83768f1-7c1d-462a-a9db-fd8922e97abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:22.736272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ae995705654dcca9de91e302cc419c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:22.744733 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ae995705654dcca9de91e302cc419c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:22.746346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:22.752162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1196/2405] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:22 2022] DELETE /identity/v3/users/d5ae995705654dcca9de91e302cc419c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:22.809805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1210/2406] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:23.087043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:23.088727 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:23.196072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47900e64-8d3e-40ce-ae77-faf65961284a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:23.203834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:23.204517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:23.204797 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:23.205070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] PATH_INFO: `/v3/projects/93ba54ddf32d4fbe9a4bcb1cc473df50` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:23.206417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ba54ddf32d4fbe9a4bcb1cc473df50)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:23.208689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:23.266534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ba54ddf32d4fbe9a4bcb1cc473df50', 'request_id': 'req-37ac69b0-9ae0-47a1-a519-1128f4ef7497'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:23.272582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ba54ddf32d4fbe9a4bcb1cc473df50', 'request_id': 'req-37ac69b0-9ae0-47a1-a519-1128f4ef7497'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:23.281685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ba54ddf32d4fbe9a4bcb1cc473df50', 'request_id': 'req-37ac69b0-9ae0-47a1-a519-1128f4ef7497'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:23.296700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] The token cache is being invalidate because project 93ba54ddf32d4fbe9a4bcb1cc473df50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:23.297048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:23.297686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-37ac69b0-9ae0-47a1-a519-1128f4ef7497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:23.304671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1197/2407] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:23 2022] DELETE /identity/v3/projects/93ba54ddf32d4fbe9a4bcb1cc473df50 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:23.306588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae30e4-512d-4917-aa7a-e19397fe7e8d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:23.306933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae30e4-512d-4917-aa7a-e19397fe7e8d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:23.307273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae30e4-512d-4917-aa7a-e19397fe7e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:23.327688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f1ae30e4-512d-4917-aa7a-e19397fe7e8d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:23.329031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f1ae30e4-512d-4917-aa7a-e19397fe7e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:23.342228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:23.407214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1211/2408] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:23.415026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e69b98-4ffb-4283-ab76-717c684b489a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:23.415342 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e69b98-4ffb-4283-ab76-717c684b489a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:23.415573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e69b98-4ffb-4283-ab76-717c684b489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:23.441080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-29e69b98-4ffb-4283-ab76-717c684b489a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:23.443245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-29e69b98-4ffb-4283-ab76-717c684b489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:23.452460 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1198/2409] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:23.456954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae30e4-512d-4917-aa7a-e19397fe7e8d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:23.472183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae30e4-512d-4917-aa7a-e19397fe7e8d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:23.480416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d14dc-3863-4b2c-ac10-d8ad9221717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:23.481057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d14dc-3863-4b2c-ac10-d8ad9221717c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:23.481345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d14dc-3863-4b2c-ac10-d8ad9221717c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:23.481643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d14dc-3863-4b2c-ac10-d8ad9221717c admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:23.482437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d14dc-3863-4b2c-ac10-d8ad9221717c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:10:23.482660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d14dc-3863-4b2c-ac10-d8ad9221717c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:23.484170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d14dc-3863-4b2c-ac10-d8ad9221717c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:23.501110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1212/2410] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:10:23.503327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e69b98-4ffb-4283-ab76-717c684b489a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:23.517437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e69b98-4ffb-4283-ab76-717c684b489a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:23.527699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844aaf4-76dd-41c5-a6cf-b3c3d7fb6354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:23.528865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844aaf4-76dd-41c5-a6cf-b3c3d7fb6354 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:23.529181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844aaf4-76dd-41c5-a6cf-b3c3d7fb6354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:23.529516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844aaf4-76dd-41c5-a6cf-b3c3d7fb6354 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:23.546927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844aaf4-76dd-41c5-a6cf-b3c3d7fb6354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:23.549032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844aaf4-76dd-41c5-a6cf-b3c3d7fb6354 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:23.586894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1199/2411] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:23 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:23.590917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d14dc-3863-4b2c-ac10-d8ad9221717c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:23.609783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d14dc-3863-4b2c-ac10-d8ad9221717c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:23.720079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bea21-5932-432c-a5eb-4ebacba4e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:23.721199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bea21-5932-432c-a5eb-4ebacba4e79b admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:23.722627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bea21-5932-432c-a5eb-4ebacba4e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:23.723203 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bea21-5932-432c-a5eb-4ebacba4e79b admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:23.724048 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bea21-5932-432c-a5eb-4ebacba4e79b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:23.726511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bea21-5932-432c-a5eb-4ebacba4e79b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:23.780431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1213/2412] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:23 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:10:23.785318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844aaf4-76dd-41c5-a6cf-b3c3d7fb6354 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:23.803334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844aaf4-76dd-41c5-a6cf-b3c3d7fb6354 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:23.808637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a519-fae6-4b04-a3a7-571a72f0e8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:23.809328 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a519-fae6-4b04-a3a7-571a72f0e8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:23.809689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a519-fae6-4b04-a3a7-571a72f0e8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:23.810037 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a519-fae6-4b04-a3a7-571a72f0e8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:23.810895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a519-fae6-4b04-a3a7-571a72f0e8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:23.812601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a519-fae6-4b04-a3a7-571a72f0e8b8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:23.832365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1200/2413] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:10:23.834168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bea21-5932-432c-a5eb-4ebacba4e79b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:23.847250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bea21-5932-432c-a5eb-4ebacba4e79b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:23.859374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d494f6f-7e7e-4342-b04b-2e3024adf7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:23.859969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d494f6f-7e7e-4342-b04b-2e3024adf7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:23.860415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d494f6f-7e7e-4342-b04b-2e3024adf7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:23.860703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d494f6f-7e7e-4342-b04b-2e3024adf7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:23.861381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d494f6f-7e7e-4342-b04b-2e3024adf7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:23.863370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d494f6f-7e7e-4342-b04b-2e3024adf7d7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:23.875549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1214/2414] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:23.880539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a519-fae6-4b04-a3a7-571a72f0e8b8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:23.895440 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a519-fae6-4b04-a3a7-571a72f0e8b8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:23.903324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7186b51-3e3a-4949-9ad2-988ca363348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:23.904316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7186b51-3e3a-4949-9ad2-988ca363348c admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:23.904837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7186b51-3e3a-4949-9ad2-988ca363348c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:23.905352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7186b51-3e3a-4949-9ad2-988ca363348c admin admin] PATH_INFO: `/v3/projects/b377139eec4b447d84946b74c26dc132/users/9727085cb75f402eb2062c686a50d83a/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:23.926904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7186b51-3e3a-4949-9ad2-988ca363348c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b377139eec4b447d84946b74c26dc132, user_id=9727085cb75f402eb2062c686a50d83a, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:23.930481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7186b51-3e3a-4949-9ad2-988ca363348c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:23.948165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1201/2415] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:23 2022] PUT /identity/v3/projects/b377139eec4b447d84946b74c26dc132/users/9727085cb75f402eb2062c686a50d83a/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:23.953145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663fa5-5c3b-472f-b9ea-3398c4fb4f07 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:23.953441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663fa5-5c3b-472f-b9ea-3398c4fb4f07 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:23.953768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663fa5-5c3b-472f-b9ea-3398c4fb4f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:23.976760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-00663fa5-5c3b-472f-b9ea-3398c4fb4f07 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:23.978091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-00663fa5-5c3b-472f-b9ea-3398c4fb4f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:24.056958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1215/2416] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:24.066997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7186b51-3e3a-4949-9ad2-988ca363348c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:24.068864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e7186b51-3e3a-4949-9ad2-988ca363348c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:24.106437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:24.147660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7186b51-3e3a-4949-9ad2-988ca363348c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:24.151670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebda3e8-df41-4fd1-b41a-7e55ca5241e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:24.152305 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebda3e8-df41-4fd1-b41a-7e55ca5241e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:24.152765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebda3e8-df41-4fd1-b41a-7e55ca5241e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:24.153048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebda3e8-df41-4fd1-b41a-7e55ca5241e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:24.169192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebda3e8-df41-4fd1-b41a-7e55ca5241e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:24.170786 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebda3e8-df41-4fd1-b41a-7e55ca5241e7 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:24.181912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1202/2417] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:24.967504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaddfec-2069-4252-8236-68b82f67d9ae None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:24.970332 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaddfec-2069-4252-8236-68b82f67d9ae None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:24.971192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaddfec-2069-4252-8236-68b82f67d9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:25.025551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-eeaddfec-2069-4252-8236-68b82f67d9ae None None] MFA Rules not processed for user `9727085cb75f402eb2062c686a50d83a`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:25.026775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eeaddfec-2069-4252-8236-68b82f67d9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:25.036926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:25.121650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1216/2418] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:25.138033 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebda3e8-df41-4fd1-b41a-7e55ca5241e7 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:25.139491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2ebda3e8-df41-4fd1-b41a-7e55ca5241e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:25.222631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebda3e8-df41-4fd1-b41a-7e55ca5241e7 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:25.227150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de4dfe-bbf8-472f-aea3-a54c010cf55c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:25.227778 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de4dfe-bbf8-472f-aea3-a54c010cf55c service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:25.228054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de4dfe-bbf8-472f-aea3-a54c010cf55c service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:25.228344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de4dfe-bbf8-472f-aea3-a54c010cf55c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:25.238130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de4dfe-bbf8-472f-aea3-a54c010cf55c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:25.239738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de4dfe-bbf8-472f-aea3-a54c010cf55c service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:25.250160 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1203/2419] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:26.542219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17426a61-9838-43c7-930c-dd46462887f7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:26.542790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17426a61-9838-43c7-930c-dd46462887f7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:26.542790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17426a61-9838-43c7-930c-dd46462887f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:26.573644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-17426a61-9838-43c7-930c-dd46462887f7 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:26.575070 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-17426a61-9838-43c7-930c-dd46462887f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:26.689117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1217/2420] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:10:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:10:26.697400 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7e4ca-e40e-4195-8dc0-322870abce3d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:26.698155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7e4ca-e40e-4195-8dc0-322870abce3d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:26.698155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7e4ca-e40e-4195-8dc0-322870abce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:26.714036 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17426a61-9838-43c7-930c-dd46462887f7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:26.716050 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-17426a61-9838-43c7-930c-dd46462887f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:26.732479 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ace7e4ca-e40e-4195-8dc0-322870abce3d None None] MFA Rules not processed for user `9727085cb75f402eb2062c686a50d83a`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:26.735074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ace7e4ca-e40e-4195-8dc0-322870abce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:26.748108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1204/2421] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:26.840309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17426a61-9838-43c7-930c-dd46462887f7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:26.847291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc0aa7-eca4-491f-9dee-8fc24abd1c32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:26.847959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc0aa7-eca4-491f-9dee-8fc24abd1c32 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:26.848246 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc0aa7-eca4-491f-9dee-8fc24abd1c32 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:26.848557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc0aa7-eca4-491f-9dee-8fc24abd1c32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:26.857918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc0aa7-eca4-491f-9dee-8fc24abd1c32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:26.859638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc0aa7-eca4-491f-9dee-8fc24abd1c32 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:26.875742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1218/2422] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:10:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 01:10:36.721252 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=44 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:36.871144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=80 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:39.530431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483fd4e-2f90-48d5-8a51-221fcc4ff031 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:39.530963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483fd4e-2f90-48d5-8a51-221fcc4ff031 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:39.531060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483fd4e-2f90-48d5-8a51-221fcc4ff031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:39.551481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0483fd4e-2f90-48d5-8a51-221fcc4ff031 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:39.552981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0483fd4e-2f90-48d5-8a51-221fcc4ff031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:39.560574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1205/2423] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:39.577997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc0aa7-eca4-491f-9dee-8fc24abd1c32 service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:39.593163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc0aa7-eca4-491f-9dee-8fc24abd1c32 service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:39.598774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef5cb-2cc3-4c72-b4b2-ed4174b189cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:39.599380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef5cb-2cc3-4c72-b4b2-ed4174b189cf service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:39.599665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef5cb-2cc3-4c72-b4b2-ed4174b189cf service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:39.599939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef5cb-2cc3-4c72-b4b2-ed4174b189cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:39.608431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbef5cb-2cc3-4c72-b4b2-ed4174b189cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:39.610072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbef5cb-2cc3-4c72-b4b2-ed4174b189cf service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:39.620434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1219/2424] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:10:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:10:49.545173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:49.616450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:53.028465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483fd4e-2f90-48d5-8a51-221fcc4ff031 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:53.029888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0483fd4e-2f90-48d5-8a51-221fcc4ff031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:53.044147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483fd4e-2f90-48d5-8a51-221fcc4ff031 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:53.048650 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:53.049273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:53.049554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:53.049900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] PATH_INFO: `/v3/users/fc69edf9dd064d45b91c0ee7adfba583` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:53.051070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc69edf9dd064d45b91c0ee7adfba583)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:53.053008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:53.115361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc69edf9dd064d45b91c0ee7adfba583'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:53.116026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc69edf9dd064d45b91c0ee7adfba583'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:53.124576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc69edf9dd064d45b91c0ee7adfba583'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:53.142708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc69edf9dd064d45b91c0ee7adfba583'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:53.150828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc69edf9dd064d45b91c0ee7adfba583'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:53.157467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1206/2425] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:53 2022] DELETE /identity/v3/users/fc69edf9dd064d45b91c0ee7adfba583 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:53.162955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca657f3-30e1-4b69-bc9f-2c078d5cef34 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:53.163700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca657f3-30e1-4b69-bc9f-2c078d5cef34 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:53.163700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca657f3-30e1-4b69-bc9f-2c078d5cef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:53.186215 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4ca657f3-30e1-4b69-bc9f-2c078d5cef34 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:53.187435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4ca657f3-30e1-4b69-bc9f-2c078d5cef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:53.265486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1220/2426] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:53.276751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:53.278645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:53.385620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdbd62-ad70-4e44-bdd9-6e56c14debad admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:53.395456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbc923-9167-4253-8c37-4aee2b2a8f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:53.396448 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc923-9167-4253-8c37-4aee2b2a8f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:53.396901 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc923-9167-4253-8c37-4aee2b2a8f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:53.397490 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc923-9167-4253-8c37-4aee2b2a8f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:53.412961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbc923-9167-4253-8c37-4aee2b2a8f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:53.414547 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbc923-9167-4253-8c37-4aee2b2a8f7f service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:53.426056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1207/2427] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:53.830809 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca657f3-30e1-4b69-bc9f-2c078d5cef34 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:53.832597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4ca657f3-30e1-4b69-bc9f-2c078d5cef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:53.844641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca657f3-30e1-4b69-bc9f-2c078d5cef34 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:53.850168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:53.850883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:53.851254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:53.851595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] PATH_INFO: `/v3/projects/2cdb7abc108e4867864bd4568b4fc6fe` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:53.852821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cdb7abc108e4867864bd4568b4fc6fe)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:53.854901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:53.909113 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cdb7abc108e4867864bd4568b4fc6fe', 'request_id': 'req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:53.915783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cdb7abc108e4867864bd4568b4fc6fe', 'request_id': 'req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:53.926456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cdb7abc108e4867864bd4568b4fc6fe', 'request_id': 'req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:53.942186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] The token cache is being invalidate because project 2cdb7abc108e4867864bd4568b4fc6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:53.943238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:53.944049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-fbc2725c-8466-4ef6-9c9e-e46b18de51b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:53.945674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1221/2428] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:53 2022] DELETE /identity/v3/projects/2cdb7abc108e4867864bd4568b4fc6fe => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:53.950564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ffbef-576d-4725-945c-63d6b312541d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:53.950857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ffbef-576d-4725-945c-63d6b312541d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:53.951126 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ffbef-576d-4725-945c-63d6b312541d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:53.974145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-984ffbef-576d-4725-945c-63d6b312541d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:53.975582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-984ffbef-576d-4725-945c-63d6b312541d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:54.071410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1208/2429] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:10:54.078683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e26b7e-a02f-4cd0-99c9-7b91f9a766d0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:54.079028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e26b7e-a02f-4cd0-99c9-7b91f9a766d0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:54.079354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e26b7e-a02f-4cd0-99c9-7b91f9a766d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:54.103664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-01e26b7e-a02f-4cd0-99c9-7b91f9a766d0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:54.104919 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-01e26b7e-a02f-4cd0-99c9-7b91f9a766d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:54.119258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1222/2430] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:54.123980 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ffbef-576d-4725-945c-63d6b312541d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:54.136622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ffbef-576d-4725-945c-63d6b312541d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:54.141826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ed26a-1f40-4016-9d45-b4ffec00e441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:54.142676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ed26a-1f40-4016-9d45-b4ffec00e441 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:54.143108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ed26a-1f40-4016-9d45-b4ffec00e441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:54.148473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ed26a-1f40-4016-9d45-b4ffec00e441 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:54.148473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ed26a-1f40-4016-9d45-b4ffec00e441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:10:54.148473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ed26a-1f40-4016-9d45-b4ffec00e441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:54.148823 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ed26a-1f40-4016-9d45-b4ffec00e441 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:54.163647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1209/2431] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:10:54.168289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e26b7e-a02f-4cd0-99c9-7b91f9a766d0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:54.179013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e26b7e-a02f-4cd0-99c9-7b91f9a766d0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:54.184345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93055a6-4c4a-46ba-831f-7348b8ef1e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:54.185035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93055a6-4c4a-46ba-831f-7348b8ef1e58 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:54.185384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93055a6-4c4a-46ba-831f-7348b8ef1e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:54.185720 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93055a6-4c4a-46ba-831f-7348b8ef1e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:54.186501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93055a6-4c4a-46ba-831f-7348b8ef1e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:54.188526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93055a6-4c4a-46ba-831f-7348b8ef1e58 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:54.220282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1223/2432] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:10:54 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:10:54.222787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ed26a-1f40-4016-9d45-b4ffec00e441 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:54.229418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:54.236247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ed26a-1f40-4016-9d45-b4ffec00e441 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:54.300601 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8767-ad09-4326-a444-a5fe1c4110ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:54.301266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8767-ad09-4326-a444-a5fe1c4110ad admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:54.301563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8767-ad09-4326-a444-a5fe1c4110ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:54.301840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8767-ad09-4326-a444-a5fe1c4110ad admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:54.302532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8767-ad09-4326-a444-a5fe1c4110ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:54.304974 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8767-ad09-4326-a444-a5fe1c4110ad admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:54.325865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1210/2433] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:10:54 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:10:54.330146 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93055a6-4c4a-46ba-831f-7348b8ef1e58 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:54.341498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93055a6-4c4a-46ba-831f-7348b8ef1e58 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:54.345946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a0e75-1312-4032-b7e1-5cffac2e5e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:54.346553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a0e75-1312-4032-b7e1-5cffac2e5e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:54.347631 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a0e75-1312-4032-b7e1-5cffac2e5e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:54.348008 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a0e75-1312-4032-b7e1-5cffac2e5e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:54.348698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a0e75-1312-4032-b7e1-5cffac2e5e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:54.350666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a0e75-1312-4032-b7e1-5cffac2e5e6d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:54.363130 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1224/2434] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:54.367229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8767-ad09-4326-a444-a5fe1c4110ad admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:54.377538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8767-ad09-4326-a444-a5fe1c4110ad admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:54.382299 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c297c5-f717-41fa-97a1-916a6d460f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:54.382899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c297c5-f717-41fa-97a1-916a6d460f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:54.383188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c297c5-f717-41fa-97a1-916a6d460f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:54.383511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c297c5-f717-41fa-97a1-916a6d460f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:54.384102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c297c5-f717-41fa-97a1-916a6d460f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:54.385784 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c297c5-f717-41fa-97a1-916a6d460f86 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:54.397518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1211/2435] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:10:54.401551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a0e75-1312-4032-b7e1-5cffac2e5e6d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:54.412298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a0e75-1312-4032-b7e1-5cffac2e5e6d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:54.417443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a57e66-2d11-475f-bb33-66bdc47d54a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:54.418094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a57e66-2d11-475f-bb33-66bdc47d54a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:54.418483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a57e66-2d11-475f-bb33-66bdc47d54a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:54.418639 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a57e66-2d11-475f-bb33-66bdc47d54a8 admin admin] PATH_INFO: `/v3/projects/a379b9248e76431887227f18cbbdec28/users/d68eecc556e6435983624430e77d776c/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:54.439376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a57e66-2d11-475f-bb33-66bdc47d54a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a379b9248e76431887227f18cbbdec28, user_id=d68eecc556e6435983624430e77d776c, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:54.442515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a57e66-2d11-475f-bb33-66bdc47d54a8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:54.455934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1225/2436] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:10:54 2022] PUT /identity/v3/projects/a379b9248e76431887227f18cbbdec28/users/d68eecc556e6435983624430e77d776c/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:54.467054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ea63b-149b-4c5d-a474-81706ce341ef None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:54.467348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ea63b-149b-4c5d-a474-81706ce341ef None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:54.467625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ea63b-149b-4c5d-a474-81706ce341ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:54.499677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-105ea63b-149b-4c5d-a474-81706ce341ef None None] MFA Rules not processed for user `d68eecc556e6435983624430e77d776c`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:54.500971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-105ea63b-149b-4c5d-a474-81706ce341ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:54.577917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1212/2437] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:54.589357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a57e66-2d11-475f-bb33-66bdc47d54a8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:54.591290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e9a57e66-2d11-475f-bb33-66bdc47d54a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:54.626300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:54.671403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a57e66-2d11-475f-bb33-66bdc47d54a8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:54.678881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f27c56-dfcf-404a-9af8-0d23a500d049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:54.679601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f27c56-dfcf-404a-9af8-0d23a500d049 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:54.679964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f27c56-dfcf-404a-9af8-0d23a500d049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:54.680310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f27c56-dfcf-404a-9af8-0d23a500d049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:54.692586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f27c56-dfcf-404a-9af8-0d23a500d049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:54.694190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f27c56-dfcf-404a-9af8-0d23a500d049 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:54.707448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1226/2438] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:56.088135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe67cf-9591-43ca-919a-623a8ffdf25b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:56.088733 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe67cf-9591-43ca-919a-623a8ffdf25b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:56.088733 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe67cf-9591-43ca-919a-623a8ffdf25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:56.107650 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-eabe67cf-9591-43ca-919a-623a8ffdf25b None None] MFA Rules not processed for user `d68eecc556e6435983624430e77d776c`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:56.108970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eabe67cf-9591-43ca-919a-623a8ffdf25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:56.116550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1213/2439] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:57.453908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f27c56-dfcf-404a-9af8-0d23a500d049 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:57.455379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e8f27c56-dfcf-404a-9af8-0d23a500d049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:57.579881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f27c56-dfcf-404a-9af8-0d23a500d049 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:57.586544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:57.587188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:57.587517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:57.587938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] PATH_INFO: `/v3/users/d489d4138723436c897518a3bb273cbf` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:57.589171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d489d4138723436c897518a3bb273cbf)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:57.591358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:57.658995 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd489d4138723436c897518a3bb273cbf'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:57.667122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd489d4138723436c897518a3bb273cbf'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:57.677390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd489d4138723436c897518a3bb273cbf'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:57.685331 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd489d4138723436c897518a3bb273cbf'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:57.700221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd489d4138723436c897518a3bb273cbf'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:57.706551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1227/2440] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:10:57 2022] DELETE /identity/v3/users/d489d4138723436c897518a3bb273cbf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:57.711054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85685-57c2-4241-af95-0b0380ec8bfc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:57.711541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85685-57c2-4241-af95-0b0380ec8bfc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:57.711638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85685-57c2-4241-af95-0b0380ec8bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:57.731791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-92c85685-57c2-4241-af95-0b0380ec8bfc None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:57.733053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-92c85685-57c2-4241-af95-0b0380ec8bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:57.795333 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1214/2441] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:57.805843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:57.807494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:57.877742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:57.899857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae36512-ed1e-4469-8f78-e406019c928c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:57.904999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4ea5-c18b-420c-af9e-904607fa1548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:57.905902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4ea5-c18b-420c-af9e-904607fa1548 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:57.906292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4ea5-c18b-420c-af9e-904607fa1548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:57.906663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4ea5-c18b-420c-af9e-904607fa1548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:57.921542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4ea5-c18b-420c-af9e-904607fa1548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:57.923520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4ea5-c18b-420c-af9e-904607fa1548 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:57.942848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1228/2442] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:10:58.358357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c85685-57c2-4241-af95-0b0380ec8bfc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:58.360290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-92c85685-57c2-4241-af95-0b0380ec8bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:58.375305 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:10:58.386572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c85685-57c2-4241-af95-0b0380ec8bfc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:58.400347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:58.401449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:58.401753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:58.402425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] PATH_INFO: `/v3/projects/b7c3f527fae4424ba6b6ffc0bb09f8a5` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:58.403818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c3f527fae4424ba6b6ffc0bb09f8a5)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:58.406082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:58.485898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c3f527fae4424ba6b6ffc0bb09f8a5', 'request_id': 'req-fcb35bab-b702-4642-8d5c-a7a62286ea64'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:58.494387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c3f527fae4424ba6b6ffc0bb09f8a5', 'request_id': 'req-fcb35bab-b702-4642-8d5c-a7a62286ea64'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:58.504157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c3f527fae4424ba6b6ffc0bb09f8a5', 'request_id': 'req-fcb35bab-b702-4642-8d5c-a7a62286ea64'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:58.529388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] The token cache is being invalidate because project b7c3f527fae4424ba6b6ffc0bb09f8a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:10:58.529971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:58.531072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fcb35bab-b702-4642-8d5c-a7a62286ea64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:10:58.533493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1215/2443] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:10:58 2022] DELETE /identity/v3/projects/b7c3f527fae4424ba6b6ffc0bb09f8a5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:10:58.849834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04e17d-2a8f-4129-9e2a-4582c9d0c66a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:58.850368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04e17d-2a8f-4129-9e2a-4582c9d0c66a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:58.850488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04e17d-2a8f-4129-9e2a-4582c9d0c66a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:58.851774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1229/2444] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:10:58.857426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e16dd0-4d07-4ee0-9674-575c728daa56 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:58.858220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e16dd0-4d07-4ee0-9674-575c728daa56 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:58.858501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e16dd0-4d07-4ee0-9674-575c728daa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:58.880471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b8e16dd0-4d07-4ee0-9674-575c728daa56 None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:58.882590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b8e16dd0-4d07-4ee0-9674-575c728daa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:59.006564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1216/2445] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:10:59.028137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04e17d-2a8f-4129-9e2a-4582c9d0c66a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:59.029991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ba04e17d-2a8f-4129-9e2a-4582c9d0c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:59.117874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04e17d-2a8f-4129-9e2a-4582c9d0c66a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:59.121961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e6bea-9f51-494a-9a07-55c34183deff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb70dd34dc642cfbb49b4e1a0434399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:59.122635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6bea-9f51-494a-9a07-55c34183deff service glance] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:59.122917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6bea-9f51-494a-9a07-55c34183deff service glance] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:59.123635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6bea-9f51-494a-9a07-55c34183deff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:59.134453 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e6bea-9f51-494a-9a07-55c34183deff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:59.135907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e6bea-9f51-494a-9a07-55c34183deff service glance] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:59.148684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1230/2446] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:59.222414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdc91a-9167-494d-ae12-5b9815891f10 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:59.222414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdc91a-9167-494d-ae12-5b9815891f10 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:59.222414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdc91a-9167-494d-ae12-5b9815891f10 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:59.224001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1217/2447] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:10:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 01:10:59.230450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb765e-5b60-4dce-b38e-edd036c2653b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:59.230771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb765e-5b60-4dce-b38e-edd036c2653b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:59.231056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb765e-5b60-4dce-b38e-edd036c2653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:59.256649 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-33cb765e-5b60-4dce-b38e-edd036c2653b None None] MFA Rules not processed for user `f6c13711596647178ad3f93865eca187`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:59.257758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-33cb765e-5b60-4dce-b38e-edd036c2653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:59.312134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1231/2448] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:59.323969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdc91a-9167-494d-ae12-5b9815891f10 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:59.325638 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f2cdc91a-9167-494d-ae12-5b9815891f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:59.338818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdc91a-9167-494d-ae12-5b9815891f10 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:59.342293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a1bf1-58e1-45a2-a56b-2433fcc03af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:59.342889 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a1bf1-58e1-45a2-a56b-2433fcc03af4 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:59.343171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a1bf1-58e1-45a2-a56b-2433fcc03af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:59.343449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a1bf1-58e1-45a2-a56b-2433fcc03af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:59.351291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a1bf1-58e1-45a2-a56b-2433fcc03af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:59.352772 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a1bf1-58e1-45a2-a56b-2433fcc03af4 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:59.360794 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1218/2449] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:10:59.454181 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5a64-d9ad-48ff-b59b-67f25ac8d405 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:59.454825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5a64-d9ad-48ff-b59b-67f25ac8d405 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:59.455221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5a64-d9ad-48ff-b59b-67f25ac8d405 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:59.457769 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1232/2450] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:10:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:10:59.463845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96270d4-4594-4c5b-86f9-d4e84f2994c2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:59.464213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96270d4-4594-4c5b-86f9-d4e84f2994c2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:59.464654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96270d4-4594-4c5b-86f9-d4e84f2994c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:59.487902 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b96270d4-4594-4c5b-86f9-d4e84f2994c2 None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:10:59.489270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b96270d4-4594-4c5b-86f9-d4e84f2994c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:59.506877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1219/2451] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:10:59.520549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd5a64-d9ad-48ff-b59b-67f25ac8d405 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:10:59.522812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6dbd5a64-d9ad-48ff-b59b-67f25ac8d405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:10:59.537416 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd5a64-d9ad-48ff-b59b-67f25ac8d405 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:10:59.542482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf008731-4c9e-4cde-af31-59b1ef1321c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:10:59.543393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf008731-4c9e-4cde-af31-59b1ef1321c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:10:59.543572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf008731-4c9e-4cde-af31-59b1ef1321c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:10:59.543855 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf008731-4c9e-4cde-af31-59b1ef1321c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:10:59.555160 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf008731-4c9e-4cde-af31-59b1ef1321c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:10:59.557069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf008731-4c9e-4cde-af31-59b1ef1321c8 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:10:59.571541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1233/2452] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:11:00.541972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96270d4-4594-4c5b-86f9-d4e84f2994c2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:00.552967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96270d4-4594-4c5b-86f9-d4e84f2994c2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:00.557101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908f890-e3f4-416b-bd98-6819d5a4b040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:00.558194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908f890-e3f4-416b-bd98-6819d5a4b040 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:00.558780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908f890-e3f4-416b-bd98-6819d5a4b040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:00.559336 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908f890-e3f4-416b-bd98-6819d5a4b040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:00.561724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d908f890-e3f4-416b-bd98-6819d5a4b040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:00.632707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:11:00.639501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908f890-e3f4-416b-bd98-6819d5a4b040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:00.643225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908f890-e3f4-416b-bd98-6819d5a4b040 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:00.662296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1220/2453] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:11:04.619488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73bd8-f02e-4171-a8ae-f0940b42d72c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:04.620025 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73bd8-f02e-4171-a8ae-f0940b42d72c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:04.620025 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73bd8-f02e-4171-a8ae-f0940b42d72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:04.650992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-50c73bd8-f02e-4171-a8ae-f0940b42d72c None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:04.652440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-50c73bd8-f02e-4171-a8ae-f0940b42d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:04.732379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1234/2454] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:11:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:04.744726 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908f890-e3f4-416b-bd98-6819d5a4b040 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:04.746264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d908f890-e3f4-416b-bd98-6819d5a4b040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:04.842965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908f890-e3f4-416b-bd98-6819d5a4b040 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:04.849957 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5d87-dfa5-41a4-a84e-ea9a02abd211 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:04.850710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5d87-dfa5-41a4-a84e-ea9a02abd211 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:04.851096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5d87-dfa5-41a4-a84e-ea9a02abd211 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:04.851468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5d87-dfa5-41a4-a84e-ea9a02abd211 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:04.863267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e5d87-dfa5-41a4-a84e-ea9a02abd211 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:04.864999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e5d87-dfa5-41a4-a84e-ea9a02abd211 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:04.875480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1221/2455] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:11:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:11:14.724586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=87 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:11:14.871226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=35 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:11:23.074926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e462b2-0cf3-4d33-ae90-0c108649e1ac None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:23.075551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e462b2-0cf3-4d33-ae90-0c108649e1ac None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:23.075551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e462b2-0cf3-4d33-ae90-0c108649e1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:23.096213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-27e462b2-0cf3-4d33-ae90-0c108649e1ac None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:23.097664 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-27e462b2-0cf3-4d33-ae90-0c108649e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:23.157637 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1235/2456] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:23.189684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5d87-dfa5-41a4-a84e-ea9a02abd211 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:23.191702 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-342e5d87-dfa5-41a4-a84e-ea9a02abd211 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:23.207837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5d87-dfa5-41a4-a84e-ea9a02abd211 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:23.213391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4991ac6-ef00-4e62-a946-64205643bcab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:23.213991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991ac6-ef00-4e62-a946-64205643bcab service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:23.214275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991ac6-ef00-4e62-a946-64205643bcab service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:23.214555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991ac6-ef00-4e62-a946-64205643bcab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:23.222828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4991ac6-ef00-4e62-a946-64205643bcab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:23.224423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4991ac6-ef00-4e62-a946-64205643bcab service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:23.233853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1222/2457] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:11:28.116442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed54b5-d7f7-4c1c-b231-56e2ab115722 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:28.117068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed54b5-d7f7-4c1c-b231-56e2ab115722 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:28.117068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed54b5-d7f7-4c1c-b231-56e2ab115722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:28.137414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c4ed54b5-d7f7-4c1c-b231-56e2ab115722 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:28.138613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c4ed54b5-d7f7-4c1c-b231-56e2ab115722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:28.146832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1236/2458] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:28.162469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4991ac6-ef00-4e62-a946-64205643bcab service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:28.173612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4991ac6-ef00-4e62-a946-64205643bcab service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:28.179675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc3b7-7e17-492f-9444-fef01c6f5d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:28.180269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc3b7-7e17-492f-9444-fef01c6f5d49 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:28.180590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc3b7-7e17-492f-9444-fef01c6f5d49 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:28.180859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc3b7-7e17-492f-9444-fef01c6f5d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:28.188731 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cc3b7-7e17-492f-9444-fef01c6f5d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:28.190284 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cc3b7-7e17-492f-9444-fef01c6f5d49 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:28.200039 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1223/2459] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:11:28.515350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2e901-9df4-4bfa-beff-0ae43a84d485 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:28.515707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2e901-9df4-4bfa-beff-0ae43a84d485 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:28.515984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2e901-9df4-4bfa-beff-0ae43a84d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:28.537798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9ea2e901-9df4-4bfa-beff-0ae43a84d485 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:28.539067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9ea2e901-9df4-4bfa-beff-0ae43a84d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:28.547346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1237/2460] 10.222.0.83 () {58 vars in 967 bytes} [Wed Aug 31 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:28.572696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc3b7-7e17-492f-9444-fef01c6f5d49 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:28.584185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc3b7-7e17-492f-9444-fef01c6f5d49 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:28.589118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8b8d3-5e9c-4aff-8a63-4ffc93f85858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:28.589716 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8b8d3-5e9c-4aff-8a63-4ffc93f85858 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:28.589997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8b8d3-5e9c-4aff-8a63-4ffc93f85858 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:28.590267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8b8d3-5e9c-4aff-8a63-4ffc93f85858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:28.598724 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8b8d3-5e9c-4aff-8a63-4ffc93f85858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:28.600283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8b8d3-5e9c-4aff-8a63-4ffc93f85858 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:28.608125 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1224/2461] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:11:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:11:30.200235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9453b3-0d80-4e0b-93b5-a2e79a7c28c6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:30.200721 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9453b3-0d80-4e0b-93b5-a2e79a7c28c6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:30.200933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9453b3-0d80-4e0b-93b5-a2e79a7c28c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:30.222794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0a9453b3-0d80-4e0b-93b5-a2e79a7c28c6 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:30.224066 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0a9453b3-0d80-4e0b-93b5-a2e79a7c28c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:30.231253 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1238/2462] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:30.243134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8b8d3-5e9c-4aff-8a63-4ffc93f85858 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:30.253654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8b8d3-5e9c-4aff-8a63-4ffc93f85858 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:30.258677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1b68-e129-4598-9f57-50b03d9dcbdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:30.259275 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1b68-e129-4598-9f57-50b03d9dcbdc service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:30.259553 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1b68-e129-4598-9f57-50b03d9dcbdc service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:30.259824 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1b68-e129-4598-9f57-50b03d9dcbdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:30.267952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf1b68-e129-4598-9f57-50b03d9dcbdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:30.270238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf1b68-e129-4598-9f57-50b03d9dcbdc service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:30.278333 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1225/2463] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:11:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:11:30.825033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933707-f08b-45ca-80b8-6a149542c3f3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:30.825322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933707-f08b-45ca-80b8-6a149542c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:30.825602 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933707-f08b-45ca-80b8-6a149542c3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:30.845193 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fd933707-f08b-45ca-80b8-6a149542c3f3 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:30.846379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fd933707-f08b-45ca-80b8-6a149542c3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:30.853576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1239/2464] 10.222.0.83 () {58 vars in 967 bytes} [Wed Aug 31 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:30.866310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1b68-e129-4598-9f57-50b03d9dcbdc service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:30.877261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1b68-e129-4598-9f57-50b03d9dcbdc service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:30.883126 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de5a7-a1f7-4c6b-a33f-49eec807c33c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:30.883722 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de5a7-a1f7-4c6b-a33f-49eec807c33c service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:30.884002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de5a7-a1f7-4c6b-a33f-49eec807c33c service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:30.884277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de5a7-a1f7-4c6b-a33f-49eec807c33c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:30.892470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7de5a7-a1f7-4c6b-a33f-49eec807c33c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:30.894049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7de5a7-a1f7-4c6b-a33f-49eec807c33c service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:30.902176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1226/2465] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:11:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:11:31.115972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab3f3e-1d09-45e6-892d-507d322ff227 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:31.116258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab3f3e-1d09-45e6-892d-507d322ff227 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:31.116567 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab3f3e-1d09-45e6-892d-507d322ff227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:31.136224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-53ab3f3e-1d09-45e6-892d-507d322ff227 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:31.137434 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-53ab3f3e-1d09-45e6-892d-507d322ff227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:31.144880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1240/2466] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:31.156528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de5a7-a1f7-4c6b-a33f-49eec807c33c service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:31.167141 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de5a7-a1f7-4c6b-a33f-49eec807c33c service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:31.172143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53def3-2d17-45d4-b71d-99870bdcdbf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:31.172764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53def3-2d17-45d4-b71d-99870bdcdbf0 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:31.173049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53def3-2d17-45d4-b71d-99870bdcdbf0 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:31.173325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53def3-2d17-45d4-b71d-99870bdcdbf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:31.181913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53def3-2d17-45d4-b71d-99870bdcdbf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:31.183405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53def3-2d17-45d4-b71d-99870bdcdbf0 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:31.192016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1227/2467] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:11:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 01:11:31.507890 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126a33b-8010-43e5-bc3c-1efe3b376193 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:31.508386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126a33b-8010-43e5-bc3c-1efe3b376193 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:31.508509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126a33b-8010-43e5-bc3c-1efe3b376193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:31.527046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1126a33b-8010-43e5-bc3c-1efe3b376193 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:31.528230 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1126a33b-8010-43e5-bc3c-1efe3b376193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:31.535796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1241/2468] 10.222.0.83 () {58 vars in 967 bytes} [Wed Aug 31 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:31.547727 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53def3-2d17-45d4-b71d-99870bdcdbf0 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:31.559138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53def3-2d17-45d4-b71d-99870bdcdbf0 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:31.564172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efe710-2d9c-43a2-82db-e7d2dae5ecdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:31.564789 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efe710-2d9c-43a2-82db-e7d2dae5ecdf service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:31.565069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efe710-2d9c-43a2-82db-e7d2dae5ecdf service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:31.565344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efe710-2d9c-43a2-82db-e7d2dae5ecdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:31.573296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efe710-2d9c-43a2-82db-e7d2dae5ecdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:31.574848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efe710-2d9c-43a2-82db-e7d2dae5ecdf service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:31.582883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1228/2469] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:11:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:11:33.661351 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126a33b-8010-43e5-bc3c-1efe3b376193 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:33.662821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1126a33b-8010-43e5-bc3c-1efe3b376193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:33.677250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126a33b-8010-43e5-bc3c-1efe3b376193 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:33.681760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:33.682382 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:33.682661 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:33.682936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] PATH_INFO: `/v3/users/d68eecc556e6435983624430e77d776c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:33.684057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68eecc556e6435983624430e77d776c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:33.686012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:33.736121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68eecc556e6435983624430e77d776c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:33.736792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68eecc556e6435983624430e77d776c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:33.744704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68eecc556e6435983624430e77d776c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:33.751802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68eecc556e6435983624430e77d776c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:33.765705 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68eecc556e6435983624430e77d776c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:33.778393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1242/2470] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:11:33 2022] DELETE /identity/v3/users/d68eecc556e6435983624430e77d776c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:11:33.782828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f909-c613-442c-b3a0-6b502dbd7222 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:33.783306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f909-c613-442c-b3a0-6b502dbd7222 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:33.783403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f909-c613-442c-b3a0-6b502dbd7222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:33.803062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e0e9f909-c613-442c-b3a0-6b502dbd7222 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:33.804247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e0e9f909-c613-442c-b3a0-6b502dbd7222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:33.861018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1229/2471] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:33.871148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:33.872591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:33.908436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:11:33.932793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0bca0-f8c3-433b-a084-d1456ba35f1b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:33.936504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b23f79-8fb4-40d3-a274-d6897f50724c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:33.937109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b23f79-8fb4-40d3-a274-d6897f50724c service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:33.937387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b23f79-8fb4-40d3-a274-d6897f50724c service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:33.937657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b23f79-8fb4-40d3-a274-d6897f50724c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:33.946742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b23f79-8fb4-40d3-a274-d6897f50724c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:33.948158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b23f79-8fb4-40d3-a274-d6897f50724c service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:33.958412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1243/2472] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:11:34.127850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f909-c613-442c-b3a0-6b502dbd7222 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:34.129746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e0e9f909-c613-442c-b3a0-6b502dbd7222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:34.145679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f909-c613-442c-b3a0-6b502dbd7222 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:34.156107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:34.156796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.157078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.157355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] PATH_INFO: `/v3/projects/a379b9248e76431887227f18cbbdec28` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.158597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a379b9248e76431887227f18cbbdec28)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:34.161182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:34.218228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a379b9248e76431887227f18cbbdec28', 'request_id': 'req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:34.225283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a379b9248e76431887227f18cbbdec28', 'request_id': 'req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:34.229709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:11:34.234158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a379b9248e76431887227f18cbbdec28', 'request_id': 'req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:34.247575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] The token cache is being invalidate because project a379b9248e76431887227f18cbbdec28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:11:34.247865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:34.248529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9aef6a4b-35a2-41a1-b2d4-f1cad01fcf54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:34.250022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1230/2473] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:11:34 2022] DELETE /identity/v3/projects/a379b9248e76431887227f18cbbdec28 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:11:34.256166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5634ea2-5b96-484d-abc1-99a6c4c4f983 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.256594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5634ea2-5b96-484d-abc1-99a6c4c4f983 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.257300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5634ea2-5b96-484d-abc1-99a6c4c4f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.279473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c5634ea2-5b96-484d-abc1-99a6c4c4f983 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:34.280766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c5634ea2-5b96-484d-abc1-99a6c4c4f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:34.350461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1244/2474] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:11:34.420383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2433c5-eb56-4400-99d6-0cf3ffa5e5fb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.420584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2433c5-eb56-4400-99d6-0cf3ffa5e5fb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.420852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2433c5-eb56-4400-99d6-0cf3ffa5e5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.443111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4a2433c5-eb56-4400-99d6-0cf3ffa5e5fb None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:34.444361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4a2433c5-eb56-4400-99d6-0cf3ffa5e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:34.452408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1231/2475] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:34.457801 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5634ea2-5b96-484d-abc1-99a6c4c4f983 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:34.467917 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5634ea2-5b96-484d-abc1-99a6c4c4f983 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:34.473090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac7f2c-94d4-43b8-a3e1-5c6930baba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:34.473701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7f2c-94d4-43b8-a3e1-5c6930baba87 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.473987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7f2c-94d4-43b8-a3e1-5c6930baba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.474265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7f2c-94d4-43b8-a3e1-5c6930baba87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.474921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac7f2c-94d4-43b8-a3e1-5c6930baba87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:11:34.475283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac7f2c-94d4-43b8-a3e1-5c6930baba87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:34.476922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac7f2c-94d4-43b8-a3e1-5c6930baba87 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:34.490035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1245/2476] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:11:34.494927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2433c5-eb56-4400-99d6-0cf3ffa5e5fb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:34.505518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2433c5-eb56-4400-99d6-0cf3ffa5e5fb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:34.510412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6c10-9ffa-40ca-97db-5f2cab3d79a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:34.511075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6c10-9ffa-40ca-97db-5f2cab3d79a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.511337 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6c10-9ffa-40ca-97db-5f2cab3d79a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.511613 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6c10-9ffa-40ca-97db-5f2cab3d79a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.512348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa6c10-9ffa-40ca-97db-5f2cab3d79a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:34.514471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa6c10-9ffa-40ca-97db-5f2cab3d79a3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:34.526616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e35e2-d3f7-4c53-943c-ea628ee8270c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.527093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e35e2-d3f7-4c53-943c-ea628ee8270c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.527564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e35e2-d3f7-4c53-943c-ea628ee8270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.549469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1232/2477] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:11:34 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:11:34.552266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b01e35e2-d3f7-4c53-943c-ea628ee8270c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:34.553606 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b01e35e2-d3f7-4c53-943c-ea628ee8270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:34.553888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6c10-9ffa-40ca-97db-5f2cab3d79a3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:34.612237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1246/2478] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:11:34.617074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6c10-9ffa-40ca-97db-5f2cab3d79a3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:34.622238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b1c2-2fa4-4a35-8ddf-5c2ad12cc45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:34.622838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b1c2-2fa4-4a35-8ddf-5c2ad12cc45b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.623124 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b1c2-2fa4-4a35-8ddf-5c2ad12cc45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.623404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b1c2-2fa4-4a35-8ddf-5c2ad12cc45b admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.624057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b1c2-2fa4-4a35-8ddf-5c2ad12cc45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:34.625999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b1c2-2fa4-4a35-8ddf-5c2ad12cc45b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:34.641402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e35e2-d3f7-4c53-943c-ea628ee8270c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:34.642772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b01e35e2-d3f7-4c53-943c-ea628ee8270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:34.652294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1233/2479] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:11:34 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:11:34.652742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b1c2-2fa4-4a35-8ddf-5c2ad12cc45b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:34.663665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b1c2-2fa4-4a35-8ddf-5c2ad12cc45b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:34.668742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735169f-ed28-4e63-8680-62287307b505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:34.669426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735169f-ed28-4e63-8680-62287307b505 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.669807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735169f-ed28-4e63-8680-62287307b505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.670182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735169f-ed28-4e63-8680-62287307b505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.670950 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735169f-ed28-4e63-8680-62287307b505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:34.672584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735169f-ed28-4e63-8680-62287307b505 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:34.685202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1234/2480] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:11:34.689242 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735169f-ed28-4e63-8680-62287307b505 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:34.700226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735169f-ed28-4e63-8680-62287307b505 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:34.705172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62bf9d-0560-4aab-8072-3951c9f3a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:34.705783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62bf9d-0560-4aab-8072-3951c9f3a3dd admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.706826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62bf9d-0560-4aab-8072-3951c9f3a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.706826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62bf9d-0560-4aab-8072-3951c9f3a3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.707245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62bf9d-0560-4aab-8072-3951c9f3a3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:34.708875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62bf9d-0560-4aab-8072-3951c9f3a3dd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:34.720007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:11:34.721201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1235/2481] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:11:34.725593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62bf9d-0560-4aab-8072-3951c9f3a3dd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:34.730615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e35e2-d3f7-4c53-943c-ea628ee8270c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:34.736158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62bf9d-0560-4aab-8072-3951c9f3a3dd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:34.737170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854e3e8-edf7-44d4-9848-a6ae49945797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:34.738565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854e3e8-edf7-44d4-9848-a6ae49945797 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.738992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854e3e8-edf7-44d4-9848-a6ae49945797 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.739280 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854e3e8-edf7-44d4-9848-a6ae49945797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.742053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c1e29-355e-423d-a2a4-d89bb7f52010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:34.742712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c1e29-355e-423d-a2a4-d89bb7f52010 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.742988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c1e29-355e-423d-a2a4-d89bb7f52010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.743293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c1e29-355e-423d-a2a4-d89bb7f52010 admin admin] PATH_INFO: `/v3/projects/7d380ef1738046b08bc199af9a148066/users/6f5e6097df7446e2836c40fcab9df595/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.749213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854e3e8-edf7-44d4-9848-a6ae49945797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:34.750824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854e3e8-edf7-44d4-9848-a6ae49945797 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:34.760176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c1e29-355e-423d-a2a4-d89bb7f52010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d380ef1738046b08bc199af9a148066, user_id=6f5e6097df7446e2836c40fcab9df595, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:34.762125 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1247/2482] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:11:34.762949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c1e29-355e-423d-a2a4-d89bb7f52010 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:34.765437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854e3e8-edf7-44d4-9848-a6ae49945797 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:34.767598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3854e3e8-edf7-44d4-9848-a6ae49945797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:34.778648 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1236/2483] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:11:34 2022] PUT /identity/v3/projects/7d380ef1738046b08bc199af9a148066/users/6f5e6097df7446e2836c40fcab9df595/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:11:34.788556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d35df2-79f6-47eb-bfec-3918c0649f0b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.789177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d35df2-79f6-47eb-bfec-3918c0649f0b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.789177 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d35df2-79f6-47eb-bfec-3918c0649f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.820695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-92d35df2-79f6-47eb-bfec-3918c0649f0b None None] MFA Rules not processed for user `6f5e6097df7446e2836c40fcab9df595`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:34.822219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-92d35df2-79f6-47eb-bfec-3918c0649f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:34.848097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854e3e8-edf7-44d4-9848-a6ae49945797 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:34.891530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:11:34.908297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1237/2484] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:34.915555 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85a05f-b29f-42fe-bfd7-a40353ed088a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:34.916273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85a05f-b29f-42fe-bfd7-a40353ed088a service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.916645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85a05f-b29f-42fe-bfd7-a40353ed088a service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.916916 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85a05f-b29f-42fe-bfd7-a40353ed088a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.917314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d35df2-79f6-47eb-bfec-3918c0649f0b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:34.918962 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-92d35df2-79f6-47eb-bfec-3918c0649f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:34.919209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8f85a05f-b29f-42fe-bfd7-a40353ed088a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:34.931885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85a05f-b29f-42fe-bfd7-a40353ed088a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:34.933449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85a05f-b29f-42fe-bfd7-a40353ed088a service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:34.943611 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1248/2485] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:11:34.976926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d35df2-79f6-47eb-bfec-3918c0649f0b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:34.980628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f6469-2577-4336-9bf0-b20bbfe5d63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:34.981239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f6469-2577-4336-9bf0-b20bbfe5d63d service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:34.981521 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f6469-2577-4336-9bf0-b20bbfe5d63d service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:34.981796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f6469-2577-4336-9bf0-b20bbfe5d63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:34.990000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f6469-2577-4336-9bf0-b20bbfe5d63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:34.991423 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f6469-2577-4336-9bf0-b20bbfe5d63d service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:35.000193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1238/2486] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:11:37.559874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16352-cb26-42e9-82ca-0416c5962cc0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:37.560377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16352-cb26-42e9-82ca-0416c5962cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:37.560495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16352-cb26-42e9-82ca-0416c5962cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:37.579109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d2c16352-cb26-42e9-82ca-0416c5962cc0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:37.580293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d2c16352-cb26-42e9-82ca-0416c5962cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:37.641154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1249/2487] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:37.655954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f6469-2577-4336-9bf0-b20bbfe5d63d service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:37.657614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-738f6469-2577-4336-9bf0-b20bbfe5d63d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:37.734538 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f6469-2577-4336-9bf0-b20bbfe5d63d service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:37.744679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38f116-0949-4709-a30e-7ca0d4e76bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:37.744679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38f116-0949-4709-a30e-7ca0d4e76bf6 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:37.744679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38f116-0949-4709-a30e-7ca0d4e76bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:37.744679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38f116-0949-4709-a30e-7ca0d4e76bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:37.750388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38f116-0949-4709-a30e-7ca0d4e76bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:37.751946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38f116-0949-4709-a30e-7ca0d4e76bf6 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:37.761769 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1239/2488] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:11:39.974985 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16352-cb26-42e9-82ca-0416c5962cc0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:39.984738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16352-cb26-42e9-82ca-0416c5962cc0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:39.990154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:39.990784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:39.991067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:39.991343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] PATH_INFO: `/v3/users/6f5e6097df7446e2836c40fcab9df595` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:39.992539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5e6097df7446e2836c40fcab9df595)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:39.994459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:40.010861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:11:40.041055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5e6097df7446e2836c40fcab9df595'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:40.041708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5e6097df7446e2836c40fcab9df595'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:40.048660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5e6097df7446e2836c40fcab9df595'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:40.056240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5e6097df7446e2836c40fcab9df595'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:40.068931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5e6097df7446e2836c40fcab9df595'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:40.074935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1250/2489] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:11:39 2022] DELETE /identity/v3/users/6f5e6097df7446e2836c40fcab9df595 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:11:40.079392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af98275-9740-4c11-9f03-125b2d83c785 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:40.079883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af98275-9740-4c11-9f03-125b2d83c785 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:40.079981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af98275-9740-4c11-9f03-125b2d83c785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:40.099108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1af98275-9740-4c11-9f03-125b2d83c785 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:40.100282 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1af98275-9740-4c11-9f03-125b2d83c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:40.159386 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1240/2490] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:40.169083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:40.170465 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:40.227703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a9b00-bae0-4098-9c2f-3a838f9e1a10 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:40.231290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cc72b-1c97-4502-b06d-06a3f039e8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:40.231945 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cc72b-1c97-4502-b06d-06a3f039e8cb service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:40.232173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cc72b-1c97-4502-b06d-06a3f039e8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:40.232480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cc72b-1c97-4502-b06d-06a3f039e8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:40.242020 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cc72b-1c97-4502-b06d-06a3f039e8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:40.243462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cc72b-1c97-4502-b06d-06a3f039e8cb service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:40.252739 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1251/2491] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:11:40.516256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af98275-9740-4c11-9f03-125b2d83c785 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:40.517736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1af98275-9740-4c11-9f03-125b2d83c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:40.530980 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af98275-9740-4c11-9f03-125b2d83c785 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:40.536076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:40.536729 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:40.537010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:40.537286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] PATH_INFO: `/v3/projects/7d380ef1738046b08bc199af9a148066` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:40.538481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d380ef1738046b08bc199af9a148066)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:40.540631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:40.562700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:11:40.587936 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d380ef1738046b08bc199af9a148066', 'request_id': 'req-87cb60cf-fa9d-46bd-ba4a-8379380128c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:40.593373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d380ef1738046b08bc199af9a148066', 'request_id': 'req-87cb60cf-fa9d-46bd-ba4a-8379380128c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:40.604389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d380ef1738046b08bc199af9a148066', 'request_id': 'req-87cb60cf-fa9d-46bd-ba4a-8379380128c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:40.616178 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] The token cache is being invalidate because project 7d380ef1738046b08bc199af9a148066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:11:40.616503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:40.617163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:11:40.618645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1241/2492] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:11:40 2022] DELETE /identity/v3/projects/7d380ef1738046b08bc199af9a148066 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:11:41.763727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17861565-6616-48b8-a047-b9b191c8912a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:41.764228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17861565-6616-48b8-a047-b9b191c8912a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:41.764495 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17861565-6616-48b8-a047-b9b191c8912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:41.784029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-17861565-6616-48b8-a047-b9b191c8912a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:41.785812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-17861565-6616-48b8-a047-b9b191c8912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:41.843055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1252/2493] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:41.861812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:41.863843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:41.937382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb60cf-fa9d-46bd-ba4a-8379380128c0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:41.942915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf7e43-4c05-4aba-8606-a7df6c20e78e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:41.943524 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf7e43-4c05-4aba-8606-a7df6c20e78e service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:41.943813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf7e43-4c05-4aba-8606-a7df6c20e78e service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:41.944090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf7e43-4c05-4aba-8606-a7df6c20e78e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:41.952054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf7e43-4c05-4aba-8606-a7df6c20e78e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:41.953657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf7e43-4c05-4aba-8606-a7df6c20e78e service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:41.963291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1242/2494] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:11:44.912388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fc97f-9327-466f-8d1e-279b2b7ec663 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:44.912892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fc97f-9327-466f-8d1e-279b2b7ec663 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:44.912991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fc97f-9327-466f-8d1e-279b2b7ec663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:44.932790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-636fc97f-9327-466f-8d1e-279b2b7ec663 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:11:44.933999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-636fc97f-9327-466f-8d1e-279b2b7ec663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:44.941828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1253/2495] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:11:44.960166 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf7e43-4c05-4aba-8606-a7df6c20e78e service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:11:44.961611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-72bf7e43-4c05-4aba-8606-a7df6c20e78e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:11:44.976406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf7e43-4c05-4aba-8606-a7df6c20e78e service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:11:44.981782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f552-b9c4-4db5-8b2b-b8fc08b1f5da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:11:44.982368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f552-b9c4-4db5-8b2b-b8fc08b1f5da service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:11:44.982648 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f552-b9c4-4db5-8b2b-b8fc08b1f5da service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:11:44.982918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f552-b9c4-4db5-8b2b-b8fc08b1f5da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:11:44.991432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9f552-b9c4-4db5-8b2b-b8fc08b1f5da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:11:44.993016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9f552-b9c4-4db5-8b2b-b8fc08b1f5da service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:11:45.002154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1243/2496] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:11:54.927961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=9,keystone:SELECT=76,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:11:54.998038 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:12:03.730607 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb190b-a91b-4751-afa0-d8947a1f6b45 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:03.731137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb190b-a91b-4751-afa0-d8947a1f6b45 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:03.731236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb190b-a91b-4751-afa0-d8947a1f6b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:03.751239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-67fb190b-a91b-4751-afa0-d8947a1f6b45 None None] MFA Rules not processed for user `9727085cb75f402eb2062c686a50d83a`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:12:03.752505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-67fb190b-a91b-4751-afa0-d8947a1f6b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:12:03.807825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1254/2497] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:12:13.800878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=25 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:12:19.207414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629947-ecf8-4ac5-9b5f-7c3ea4f10e35 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:19.207949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629947-ecf8-4ac5-9b5f-7c3ea4f10e35 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:19.208072 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629947-ecf8-4ac5-9b5f-7c3ea4f10e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:19.230342 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c1629947-ecf8-4ac5-9b5f-7c3ea4f10e35 None None] MFA Rules not processed for user `e01d1012d66b46b0806c9b77bfd161a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:12:19.231661 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c1629947-ecf8-4ac5-9b5f-7c3ea4f10e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:12:19.289014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1244/2498] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:12:19.670573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a35483-7c9b-49c8-843b-bc1c7f6df687 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:19.671097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a35483-7c9b-49c8-843b-bc1c7f6df687 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:19.671195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a35483-7c9b-49c8-843b-bc1c7f6df687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:19.691508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-26a35483-7c9b-49c8-843b-bc1c7f6df687 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:12:19.692752 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-26a35483-7c9b-49c8-843b-bc1c7f6df687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:12:19.701653 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1255/2499] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:12:19.720477 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629947-ecf8-4ac5-9b5f-7c3ea4f10e35 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:12:19.734159 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629947-ecf8-4ac5-9b5f-7c3ea4f10e35 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:12:19.740262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fa445-50c9-40fa-a5a2-00a1fbe93367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:12:19.740926 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fa445-50c9-40fa-a5a2-00a1fbe93367 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:19.741244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fa445-50c9-40fa-a5a2-00a1fbe93367 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:19.741523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fa445-50c9-40fa-a5a2-00a1fbe93367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:19.750290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fa445-50c9-40fa-a5a2-00a1fbe93367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:12:19.751878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fa445-50c9-40fa-a5a2-00a1fbe93367 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:12:19.762172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1245/2500] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:12:23.914944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af5d9-590b-4dc0-805e-6af5b0ff05ce None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:23.915502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af5d9-590b-4dc0-805e-6af5b0ff05ce None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:23.915626 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af5d9-590b-4dc0-805e-6af5b0ff05ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:23.934666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-211af5d9-590b-4dc0-805e-6af5b0ff05ce None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:12:23.935868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-211af5d9-590b-4dc0-805e-6af5b0ff05ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:12:23.943966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1256/2501] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:12:23.960697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fa445-50c9-40fa-a5a2-00a1fbe93367 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:12:23.972680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fa445-50c9-40fa-a5a2-00a1fbe93367 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:12:23.978653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c93fe9-91dc-4478-9913-3ba0e216f1a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:12:23.979251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c93fe9-91dc-4478-9913-3ba0e216f1a1 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:23.979534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c93fe9-91dc-4478-9913-3ba0e216f1a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:23.979813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c93fe9-91dc-4478-9913-3ba0e216f1a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:23.987977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c93fe9-91dc-4478-9913-3ba0e216f1a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:12:23.989598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c93fe9-91dc-4478-9913-3ba0e216f1a1 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:12:24.000104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1246/2502] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:12:31.121350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446647b8-2877-4c51-aa54-f80e1a515a87 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:31.121842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446647b8-2877-4c51-aa54-f80e1a515a87 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:31.122345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446647b8-2877-4c51-aa54-f80e1a515a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:31.144903 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-446647b8-2877-4c51-aa54-f80e1a515a87 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:12:31.146392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-446647b8-2877-4c51-aa54-f80e1a515a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:12:31.156238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1257/2503] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:12:31.171883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c93fe9-91dc-4478-9913-3ba0e216f1a1 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:12:31.184513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c93fe9-91dc-4478-9913-3ba0e216f1a1 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:12:31.190088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be4eb6-bb9f-4d30-aebc-3b88e91c5162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:12:31.190690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4eb6-bb9f-4d30-aebc-3b88e91c5162 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:31.190999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4eb6-bb9f-4d30-aebc-3b88e91c5162 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:31.191292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4eb6-bb9f-4d30-aebc-3b88e91c5162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:31.200301 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be4eb6-bb9f-4d30-aebc-3b88e91c5162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:12:31.202137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be4eb6-bb9f-4d30-aebc-3b88e91c5162 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:12:31.212590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1247/2504] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:12:35.305440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c82e2b-ed38-484d-819e-d2d7a1ba1d36 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:35.306616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c82e2b-ed38-484d-819e-d2d7a1ba1d36 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:35.307005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c82e2b-ed38-484d-819e-d2d7a1ba1d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:35.329335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b2c82e2b-ed38-484d-819e-d2d7a1ba1d36 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:12:35.330864 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b2c82e2b-ed38-484d-819e-d2d7a1ba1d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:12:35.339328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1258/2505] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:12:35.360500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be4eb6-bb9f-4d30-aebc-3b88e91c5162 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:12:35.373012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be4eb6-bb9f-4d30-aebc-3b88e91c5162 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:12:35.378748 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a4a61-ddd7-4d0b-be5d-8f3593da9e29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:12:35.379344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a4a61-ddd7-4d0b-be5d-8f3593da9e29 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:35.379627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a4a61-ddd7-4d0b-be5d-8f3593da9e29 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:35.379900 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a4a61-ddd7-4d0b-be5d-8f3593da9e29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:35.389907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a4a61-ddd7-4d0b-be5d-8f3593da9e29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:12:35.391475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a4a61-ddd7-4d0b-be5d-8f3593da9e29 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:12:35.401905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1248/2506] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:12:36.654708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717e156-1102-4811-baff-a9172ca0193c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:36.655273 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717e156-1102-4811-baff-a9172ca0193c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:36.655396 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717e156-1102-4811-baff-a9172ca0193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:36.674850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1717e156-1102-4811-baff-a9172ca0193c None None] MFA Rules not processed for user `f7eebe335f274e7aaabb0266583caf89`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:12:36.676051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1717e156-1102-4811-baff-a9172ca0193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:12:36.730779 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1259/2507] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:12:39.512216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dcc8e-8b2d-4ba7-a45b-0d74485f3005 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:39.512861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dcc8e-8b2d-4ba7-a45b-0d74485f3005 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:39.512861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dcc8e-8b2d-4ba7-a45b-0d74485f3005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:39.534840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8e6dcc8e-8b2d-4ba7-a45b-0d74485f3005 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:12:39.536147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8e6dcc8e-8b2d-4ba7-a45b-0d74485f3005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:12:39.545595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1249/2508] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:12:39.568004 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717e156-1102-4811-baff-a9172ca0193c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:12:39.582011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717e156-1102-4811-baff-a9172ca0193c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:12:39.587634 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a826-e22b-468e-9cc2-db53d7ddcd51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:12:39.588956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a826-e22b-468e-9cc2-db53d7ddcd51 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:12:39.589296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a826-e22b-468e-9cc2-db53d7ddcd51 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:12:39.589629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a826-e22b-468e-9cc2-db53d7ddcd51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:12:39.598505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7a826-e22b-468e-9cc2-db53d7ddcd51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:12:39.600171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7a826-e22b-468e-9cc2-db53d7ddcd51 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:12:39.610835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1260/2509] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:12:49.527861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=52 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:12:49.606162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=43 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:09.855953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f1d9a-24c0-4512-9748-4e770b465c27 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:09.856422 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f1d9a-24c0-4512-9748-4e770b465c27 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:09.856574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f1d9a-24c0-4512-9748-4e770b465c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:09.875910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-da8f1d9a-24c0-4512-9748-4e770b465c27 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:09.877128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-da8f1d9a-24c0-4512-9748-4e770b465c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:09.931089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1250/2510] 10.222.0.83 () {58 vars in 967 bytes} [Wed Aug 31 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:13:09.978446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a826-e22b-468e-9cc2-db53d7ddcd51 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:09.979866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f4d7a826-e22b-468e-9cc2-db53d7ddcd51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:10.050603 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a826-e22b-468e-9cc2-db53d7ddcd51 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:10.055482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef18ea-4035-46c0-bc93-2ae821aac113 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:10.056081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef18ea-4035-46c0-bc93-2ae821aac113 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:10.056387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef18ea-4035-46c0-bc93-2ae821aac113 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:10.056663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef18ea-4035-46c0-bc93-2ae821aac113 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:10.064441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef18ea-4035-46c0-bc93-2ae821aac113 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:10.066012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef18ea-4035-46c0-bc93-2ae821aac113 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:10.073874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1261/2511] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:13:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:13:12.285296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f1d9a-24c0-4512-9748-4e770b465c27 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:12.286800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-da8f1d9a-24c0-4512-9748-4e770b465c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:12.307827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f1d9a-24c0-4512-9748-4e770b465c27 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:12.313543 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:12.314465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:12.314814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:12.315155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] PATH_INFO: `/v3/users/9727085cb75f402eb2062c686a50d83a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:12.316573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9727085cb75f402eb2062c686a50d83a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:12.318775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:12.382052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9727085cb75f402eb2062c686a50d83a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:12.383008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9727085cb75f402eb2062c686a50d83a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:12.391864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9727085cb75f402eb2062c686a50d83a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:12.406347 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9727085cb75f402eb2062c686a50d83a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:12.413628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9727085cb75f402eb2062c686a50d83a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:12.420067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1251/2512] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:13:12 2022] DELETE /identity/v3/users/9727085cb75f402eb2062c686a50d83a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:13:12.613989 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef18ea-4035-46c0-bc93-2ae821aac113 service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:12.628086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef18ea-4035-46c0-bc93-2ae821aac113 service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:12.689852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:12.690520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:12.690805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:12.691077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] PATH_INFO: `/v3/projects/b377139eec4b447d84946b74c26dc132` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:12.692196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b377139eec4b447d84946b74c26dc132)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:12.694136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:12.742838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b377139eec4b447d84946b74c26dc132', 'request_id': 'req-916c4473-4467-4f63-8003-4ee5bd8980f9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:12.749482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b377139eec4b447d84946b74c26dc132', 'request_id': 'req-916c4473-4467-4f63-8003-4ee5bd8980f9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:12.758003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b377139eec4b447d84946b74c26dc132', 'request_id': 'req-916c4473-4467-4f63-8003-4ee5bd8980f9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:12.773279 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] The token cache is being invalidate because project b377139eec4b447d84946b74c26dc132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:13:12.773594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:12.774196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:12.775681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1262/2513] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:13:12 2022] DELETE /identity/v3/projects/b377139eec4b447d84946b74c26dc132 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:13:17.037304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:17.038854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:17.053557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5268fc-8db1-4216-a2e3-29df0b2ee24b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:17.136396 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:17.137230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:17.137354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:17.137570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] PATH_INFO: `/v3/users/94de55a6079d433284ae27c837dad550` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:17.139676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94de55a6079d433284ae27c837dad550)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:17.141713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:17.164954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:17.195283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94de55a6079d433284ae27c837dad550'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.195944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94de55a6079d433284ae27c837dad550'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.203806 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94de55a6079d433284ae27c837dad550'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.215984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94de55a6079d433284ae27c837dad550'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.223516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94de55a6079d433284ae27c837dad550'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.229389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1252/2514] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:13:17 2022] DELETE /identity/v3/users/94de55a6079d433284ae27c837dad550 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:13:17.403028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:17.404707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:17.422005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4473-4467-4f63-8003-4ee5bd8980f9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:17.441139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:17.484473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:17.485087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:17.485369 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:17.485636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] PATH_INFO: `/v3/projects/948dbd12a6e148e4ba7d6d71dc6bb780` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:17.486764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=948dbd12a6e148e4ba7d6d71dc6bb780)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:17.488897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:17.535394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948dbd12a6e148e4ba7d6d71dc6bb780', 'request_id': 'req-415739a4-b3a2-4192-b5a4-512288195bc9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.540971 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948dbd12a6e148e4ba7d6d71dc6bb780', 'request_id': 'req-415739a4-b3a2-4192-b5a4-512288195bc9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.547105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948dbd12a6e148e4ba7d6d71dc6bb780', 'request_id': 'req-415739a4-b3a2-4192-b5a4-512288195bc9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.559256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] The token cache is being invalidate because project 948dbd12a6e148e4ba7d6d71dc6bb780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:13:17.559544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.560780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.562294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1263/2515] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:13:17 2022] DELETE /identity/v3/projects/948dbd12a6e148e4ba7d6d71dc6bb780 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:13:17.566406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:17.567829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:17.581377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37c526-14f5-441f-b843-2761895bb3b1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:17.635773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:17.636413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:17.636697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:17.636971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] PATH_INFO: `/v3/users/d8ed499915814db09fe7d377a4ffaa31` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:17.638076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ed499915814db09fe7d377a4ffaa31)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:17.640720 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:17.687055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ed499915814db09fe7d377a4ffaa31'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.687624 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ed499915814db09fe7d377a4ffaa31'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.695081 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ed499915814db09fe7d377a4ffaa31'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.708789 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ed499915814db09fe7d377a4ffaa31'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.715486 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-889cf688-ce26-4d14-a3d2-2a83f55305fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ed499915814db09fe7d377a4ffaa31'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:17.721331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1253/2516] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:13:17 2022] DELETE /identity/v3/users/d8ed499915814db09fe7d377a4ffaa31 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:13:17.895468 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:17.896927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:17.911958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415739a4-b3a2-4192-b5a4-512288195bc9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:17.971470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:17.972184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:17.972429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:17.972733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] PATH_INFO: `/v3/projects/5c51d9b747014ddeae50ce1a8d5efb7e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:17.973873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c51d9b747014ddeae50ce1a8d5efb7e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:17.975898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:18.025205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c51d9b747014ddeae50ce1a8d5efb7e', 'request_id': 'req-1d5345a8-69c4-48bd-9240-671e4db63a9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:18.027218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:18.033289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c51d9b747014ddeae50ce1a8d5efb7e', 'request_id': 'req-1d5345a8-69c4-48bd-9240-671e4db63a9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:18.040928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c51d9b747014ddeae50ce1a8d5efb7e', 'request_id': 'req-1d5345a8-69c4-48bd-9240-671e4db63a9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:18.054193 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] The token cache is being invalidate because project 5c51d9b747014ddeae50ce1a8d5efb7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:13:18.054487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:18.055101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d5345a8-69c4-48bd-9240-671e4db63a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:18.056854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1264/2517] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:13:17 2022] DELETE /identity/v3/projects/5c51d9b747014ddeae50ce1a8d5efb7e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:13:18.061605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902c3e-bfc0-4d7d-8138-c9ea20f94793 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:18.062094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902c3e-bfc0-4d7d-8138-c9ea20f94793 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:18.062195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902c3e-bfc0-4d7d-8138-c9ea20f94793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:18.082972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-40902c3e-bfc0-4d7d-8138-c9ea20f94793 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:18.084055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-40902c3e-bfc0-4d7d-8138-c9ea20f94793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:18.094880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:18.154615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1254/2518] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:13:18.162404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e392743-dc98-4224-9dd7-6638aad32748 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:18.162725 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e392743-dc98-4224-9dd7-6638aad32748 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:18.163011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e392743-dc98-4224-9dd7-6638aad32748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:18.183226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6e392743-dc98-4224-9dd7-6638aad32748 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:18.184471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6e392743-dc98-4224-9dd7-6638aad32748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:18.193685 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1265/2519] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:13:18.198168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40902c3e-bfc0-4d7d-8138-c9ea20f94793 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:18.208686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40902c3e-bfc0-4d7d-8138-c9ea20f94793 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:18.213584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c9a64-49c8-4840-8e95-833936cda331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:18.214131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c9a64-49c8-4840-8e95-833936cda331 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:18.214416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c9a64-49c8-4840-8e95-833936cda331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:18.214693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c9a64-49c8-4840-8e95-833936cda331 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:18.215356 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c9a64-49c8-4840-8e95-833936cda331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:13:18.215666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c9a64-49c8-4840-8e95-833936cda331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:18.217641 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c9a64-49c8-4840-8e95-833936cda331 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:18.229526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1255/2520] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:13:18.234835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e392743-dc98-4224-9dd7-6638aad32748 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:18.244202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e392743-dc98-4224-9dd7-6638aad32748 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:18.249730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76551b-f8c9-4f1a-8966-e2d086bd69d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:18.250342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76551b-f8c9-4f1a-8966-e2d086bd69d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:18.250623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76551b-f8c9-4f1a-8966-e2d086bd69d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:18.250900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76551b-f8c9-4f1a-8966-e2d086bd69d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:18.251552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76551b-f8c9-4f1a-8966-e2d086bd69d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:18.253509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76551b-f8c9-4f1a-8966-e2d086bd69d6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:18.287155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1266/2521] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:13:18 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:13:18.288403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c9a64-49c8-4840-8e95-833936cda331 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:18.299076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c9a64-49c8-4840-8e95-833936cda331 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:18.358310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69c9a1-05ae-4282-a58c-b8cdefbbd7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:18.358934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69c9a1-05ae-4282-a58c-b8cdefbbd7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:18.359218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69c9a1-05ae-4282-a58c-b8cdefbbd7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:18.359499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69c9a1-05ae-4282-a58c-b8cdefbbd7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:18.360134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69c9a1-05ae-4282-a58c-b8cdefbbd7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:18.362128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69c9a1-05ae-4282-a58c-b8cdefbbd7f7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:18.384360 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1256/2522] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:13:18 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:13:18.387127 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76551b-f8c9-4f1a-8966-e2d086bd69d6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:18.397723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76551b-f8c9-4f1a-8966-e2d086bd69d6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:18.402388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88008e-3fac-4a0a-b23e-0addbd9db39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:18.402988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88008e-3fac-4a0a-b23e-0addbd9db39c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:18.403272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88008e-3fac-4a0a-b23e-0addbd9db39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:18.404347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88008e-3fac-4a0a-b23e-0addbd9db39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:18.404948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88008e-3fac-4a0a-b23e-0addbd9db39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:18.406576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88008e-3fac-4a0a-b23e-0addbd9db39c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:18.416415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1267/2523] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:13:18.421198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69c9a1-05ae-4282-a58c-b8cdefbbd7f7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:18.431116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69c9a1-05ae-4282-a58c-b8cdefbbd7f7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:18.436104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8748fc-2cce-44be-8c89-53a64e29027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:18.436812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8748fc-2cce-44be-8c89-53a64e29027e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:18.437097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8748fc-2cce-44be-8c89-53a64e29027e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:18.437501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8748fc-2cce-44be-8c89-53a64e29027e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:18.438014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8748fc-2cce-44be-8c89-53a64e29027e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:18.439742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8748fc-2cce-44be-8c89-53a64e29027e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:18.450366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1257/2524] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:13:18.454574 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88008e-3fac-4a0a-b23e-0addbd9db39c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:18.464957 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88008e-3fac-4a0a-b23e-0addbd9db39c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:18.470340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b010d4-456f-4087-97ac-ed98ebc3bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:18.471026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b010d4-456f-4087-97ac-ed98ebc3bd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:18.471307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b010d4-456f-4087-97ac-ed98ebc3bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:18.471583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b010d4-456f-4087-97ac-ed98ebc3bd25 admin admin] PATH_INFO: `/v3/projects/972c64cebc2b4f3aabaf685d25b49112/users/d57322ee61ad44efb335a38e449d61f6/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:18.486827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b010d4-456f-4087-97ac-ed98ebc3bd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972c64cebc2b4f3aabaf685d25b49112, user_id=d57322ee61ad44efb335a38e449d61f6, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:18.489525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b010d4-456f-4087-97ac-ed98ebc3bd25 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:18.504279 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1268/2525] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:13:18 2022] PUT /identity/v3/projects/972c64cebc2b4f3aabaf685d25b49112/users/d57322ee61ad44efb335a38e449d61f6/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:13:18.509214 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98202a9-f5cf-4fd1-b372-c97f59fcdab9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:18.509506 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98202a9-f5cf-4fd1-b372-c97f59fcdab9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:18.509787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98202a9-f5cf-4fd1-b372-c97f59fcdab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:18.529358 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e98202a9-f5cf-4fd1-b372-c97f59fcdab9 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:18.530690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e98202a9-f5cf-4fd1-b372-c97f59fcdab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:18.590214 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1258/2526] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:13:18.599840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b010d4-456f-4087-97ac-ed98ebc3bd25 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:18.601608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f8b010d4-456f-4087-97ac-ed98ebc3bd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:18.657193 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b010d4-456f-4087-97ac-ed98ebc3bd25 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:18.660857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b82e95-b7f6-4c50-a938-065695f8e9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:18.661463 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82e95-b7f6-4c50-a938-065695f8e9ae service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:18.661744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82e95-b7f6-4c50-a938-065695f8e9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:18.662024 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82e95-b7f6-4c50-a938-065695f8e9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:18.671456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b82e95-b7f6-4c50-a938-065695f8e9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:18.672928 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b82e95-b7f6-4c50-a938-065695f8e9ae service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:18.682816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1269/2527] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:13:23.440490 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79228-16ea-491a-b018-28662c883c6e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:23.441971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79228-16ea-491a-b018-28662c883c6e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:23.442257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79228-16ea-491a-b018-28662c883c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:23.475994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dca79228-16ea-491a-b018-28662c883c6e None None] MFA Rules not processed for user `d57322ee61ad44efb335a38e449d61f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:23.477729 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dca79228-16ea-491a-b018-28662c883c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:23.487747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:23.550756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1259/2528] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:13:23.555381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b82e95-b7f6-4c50-a938-065695f8e9ae service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:23.565618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b82e95-b7f6-4c50-a938-065695f8e9ae service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:23.570316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729312f-6e97-4600-8aab-332a390b32a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:23.570922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729312f-6e97-4600-8aab-332a390b32a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:23.571205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729312f-6e97-4600-8aab-332a390b32a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:23.571480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729312f-6e97-4600-8aab-332a390b32a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:23.572116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729312f-6e97-4600-8aab-332a390b32a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:23.574096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729312f-6e97-4600-8aab-332a390b32a3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:23.604860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1270/2529] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:13:23 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:13:23.609113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca79228-16ea-491a-b018-28662c883c6e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:23.623750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca79228-16ea-491a-b018-28662c883c6e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:23.682978 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdab34-b196-4f2f-a6d3-cb9570a8c7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:23.683511 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdab34-b196-4f2f-a6d3-cb9570a8c7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:23.683795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdab34-b196-4f2f-a6d3-cb9570a8c7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:23.684091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdab34-b196-4f2f-a6d3-cb9570a8c7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:23.684745 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdab34-b196-4f2f-a6d3-cb9570a8c7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:23.686826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdab34-b196-4f2f-a6d3-cb9570a8c7a3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:23.711268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1260/2530] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:13:23 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:13:23.715263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729312f-6e97-4600-8aab-332a390b32a3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:23.726464 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729312f-6e97-4600-8aab-332a390b32a3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:23.731236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0a0f2-f416-4669-bfe2-a7ca94dc2cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:23.731893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0a0f2-f416-4669-bfe2-a7ca94dc2cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:23.732181 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0a0f2-f416-4669-bfe2-a7ca94dc2cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:23.732498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0a0f2-f416-4669-bfe2-a7ca94dc2cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:23.733239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0a0f2-f416-4669-bfe2-a7ca94dc2cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:23.734856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0a0f2-f416-4669-bfe2-a7ca94dc2cb2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:23.746372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1271/2531] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:13:23.750980 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdab34-b196-4f2f-a6d3-cb9570a8c7a3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:23.761647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdab34-b196-4f2f-a6d3-cb9570a8c7a3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:23.770155 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f53f40-8323-4e72-9e75-232bed9c9131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:23.770877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53f40-8323-4e72-9e75-232bed9c9131 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:23.771615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53f40-8323-4e72-9e75-232bed9c9131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:23.771918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53f40-8323-4e72-9e75-232bed9c9131 admin admin] PATH_INFO: `/v3/projects/f10fbb67963f45188abb413f0e7f6f3d/users/7dfab3f5a0ec44a6a8fea66e027b98c8/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:23.789969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f53f40-8323-4e72-9e75-232bed9c9131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10fbb67963f45188abb413f0e7f6f3d, user_id=7dfab3f5a0ec44a6a8fea66e027b98c8, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:23.792708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f53f40-8323-4e72-9e75-232bed9c9131 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:23.807010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1261/2532] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:13:23 2022] PUT /identity/v3/projects/f10fbb67963f45188abb413f0e7f6f3d/users/7dfab3f5a0ec44a6a8fea66e027b98c8/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:13:23.811121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0a0f2-f416-4669-bfe2-a7ca94dc2cb2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:23.821627 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0a0f2-f416-4669-bfe2-a7ca94dc2cb2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:23.871412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:23.890320 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66594df-8c3e-4b17-957f-e52b50daa9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:23.891082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66594df-8c3e-4b17-957f-e52b50daa9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:23.891368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66594df-8c3e-4b17-957f-e52b50daa9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:23.891641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66594df-8c3e-4b17-957f-e52b50daa9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:23.892317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66594df-8c3e-4b17-957f-e52b50daa9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:23.893946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66594df-8c3e-4b17-957f-e52b50daa9e3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:23.907136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1272/2533] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:13:23.911343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f53f40-8323-4e72-9e75-232bed9c9131 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:23.923478 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f53f40-8323-4e72-9e75-232bed9c9131 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:23.929865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b2def-90f5-41a2-82a1-2ca8e3b077ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:23.930636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b2def-90f5-41a2-82a1-2ca8e3b077ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:23.930990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b2def-90f5-41a2-82a1-2ca8e3b077ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:23.931467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b2def-90f5-41a2-82a1-2ca8e3b077ed admin admin] PATH_INFO: `/v3/projects/f10fbb67963f45188abb413f0e7f6f3d/users/7dfab3f5a0ec44a6a8fea66e027b98c8/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:23.933581 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b2def-90f5-41a2-82a1-2ca8e3b077ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10fbb67963f45188abb413f0e7f6f3d, user_id=7dfab3f5a0ec44a6a8fea66e027b98c8, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:23.936339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b2def-90f5-41a2-82a1-2ca8e3b077ed admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:23.953156 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1262/2534] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:13:23 2022] PUT /identity/v3/projects/f10fbb67963f45188abb413f0e7f6f3d/users/7dfab3f5a0ec44a6a8fea66e027b98c8/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:13:25.268688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66594df-8c3e-4b17-957f-e52b50daa9e3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:25.334014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66594df-8c3e-4b17-957f-e52b50daa9e3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:25.394013 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59958c6a-b1ee-4427-897e-e934a950f2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:25.394778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59958c6a-b1ee-4427-897e-e934a950f2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:25.395158 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59958c6a-b1ee-4427-897e-e934a950f2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:25.395531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59958c6a-b1ee-4427-897e-e934a950f2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:25.397630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-59958c6a-b1ee-4427-897e-e934a950f2a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:25.496536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59958c6a-b1ee-4427-897e-e934a950f2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:25.498789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59958c6a-b1ee-4427-897e-e934a950f2a2 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:25.511748 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1273/2535] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:13:26.735239 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b2def-90f5-41a2-82a1-2ca8e3b077ed admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:26.751861 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b2def-90f5-41a2-82a1-2ca8e3b077ed admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:26.767451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d563817-4f73-4296-a45f-e8b613e431a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:26.768105 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563817-4f73-4296-a45f-e8b613e431a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:26.768421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563817-4f73-4296-a45f-e8b613e431a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:26.768981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563817-4f73-4296-a45f-e8b613e431a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:26.771075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d563817-4f73-4296-a45f-e8b613e431a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:26.812450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d563817-4f73-4296-a45f-e8b613e431a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:26.816157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d563817-4f73-4296-a45f-e8b613e431a2 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:26.866852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1263/2536] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:13:28.879012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047182c-8b35-4220-8485-e93cd7d0dcce None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:28.879474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047182c-8b35-4220-8485-e93cd7d0dcce None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:28.879625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047182c-8b35-4220-8485-e93cd7d0dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:28.913608 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7047182c-8b35-4220-8485-e93cd7d0dcce None None] MFA Rules not processed for user `7dfab3f5a0ec44a6a8fea66e027b98c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:28.914827 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7047182c-8b35-4220-8485-e93cd7d0dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:28.959519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:29.032813 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1274/2537] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:13:29.040546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d563817-4f73-4296-a45f-e8b613e431a2 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:29.041971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d563817-4f73-4296-a45f-e8b613e431a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:29.067319 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d563817-4f73-4296-a45f-e8b613e431a2 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:29.080424 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ce4bc-0fee-4141-afc5-db840d0dfda2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:29.081277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ce4bc-0fee-4141-afc5-db840d0dfda2 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:29.081750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ce4bc-0fee-4141-afc5-db840d0dfda2 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:29.082206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ce4bc-0fee-4141-afc5-db840d0dfda2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:29.146567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:29.163174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ce4bc-0fee-4141-afc5-db840d0dfda2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:29.165181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ce4bc-0fee-4141-afc5-db840d0dfda2 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:29.175485 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1264/2538] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:13:30.207197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b2115-bbb5-401a-987c-00d2ffec53ca None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:30.207759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b2115-bbb5-401a-987c-00d2ffec53ca None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:30.207868 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b2115-bbb5-401a-987c-00d2ffec53ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:30.229251 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b63b2115-bbb5-401a-987c-00d2ffec53ca None None] MFA Rules not processed for user `d57322ee61ad44efb335a38e449d61f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:30.230741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b63b2115-bbb5-401a-987c-00d2ffec53ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:30.240467 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1275/2539] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:13:36.730322 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ce4bc-0fee-4141-afc5-db840d0dfda2 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:36.731816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fd0ce4bc-0fee-4141-afc5-db840d0dfda2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:36.745872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ce4bc-0fee-4141-afc5-db840d0dfda2 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:36.750375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97885b4-60f9-4aef-b552-131a8ba36b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:36.750997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97885b4-60f9-4aef-b552-131a8ba36b59 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:36.751279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97885b4-60f9-4aef-b552-131a8ba36b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:36.751573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97885b4-60f9-4aef-b552-131a8ba36b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:36.753375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d97885b4-60f9-4aef-b552-131a8ba36b59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:36.819641 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97885b4-60f9-4aef-b552-131a8ba36b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:36.821115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97885b4-60f9-4aef-b552-131a8ba36b59 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:36.831910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1265/2540] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:13:37.984219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b2115-bbb5-401a-987c-00d2ffec53ca None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:37.989728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b63b2115-bbb5-401a-987c-00d2ffec53ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:38.011663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b2115-bbb5-401a-987c-00d2ffec53ca None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:38.019151 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71edad3-4141-47db-982d-2c5269ced320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:38.019785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71edad3-4141-47db-982d-2c5269ced320 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:38.020551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71edad3-4141-47db-982d-2c5269ced320 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:38.020551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71edad3-4141-47db-982d-2c5269ced320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:38.022228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f71edad3-4141-47db-982d-2c5269ced320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:38.102116 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71edad3-4141-47db-982d-2c5269ced320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:38.104028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71edad3-4141-47db-982d-2c5269ced320 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:38.116679 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1276/2541] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:13:39.985656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97885b4-60f9-4aef-b552-131a8ba36b59 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:39.987130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d97885b4-60f9-4aef-b552-131a8ba36b59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:40.003212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97885b4-60f9-4aef-b552-131a8ba36b59 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:40.008261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:40.009571 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.009855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.010131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] PATH_INFO: `/v3/users/e01d1012d66b46b0806c9b77bfd161a7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.011341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01d1012d66b46b0806c9b77bfd161a7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:40.013344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:40.066615 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01d1012d66b46b0806c9b77bfd161a7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:40.067291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01d1012d66b46b0806c9b77bfd161a7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:40.075556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01d1012d66b46b0806c9b77bfd161a7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:40.094067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01d1012d66b46b0806c9b77bfd161a7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:40.105339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a72974af-bf5a-4272-ade5-d9e367987478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01d1012d66b46b0806c9b77bfd161a7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:40.116147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1266/2542] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:13:39 2022] DELETE /identity/v3/users/e01d1012d66b46b0806c9b77bfd161a7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:13:40.317152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71edad3-4141-47db-982d-2c5269ced320 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:40.331901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71edad3-4141-47db-982d-2c5269ced320 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:40.410134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:40.410774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.411054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.411328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] PATH_INFO: `/v3/projects/a00cd6862e1e426c845413515732a204` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.412524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00cd6862e1e426c845413515732a204)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:40.414472 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:40.473671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00cd6862e1e426c845413515732a204', 'request_id': 'req-18a78616-c66b-47b2-a3d0-1c49732acd59'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:40.480211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00cd6862e1e426c845413515732a204', 'request_id': 'req-18a78616-c66b-47b2-a3d0-1c49732acd59'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:40.488413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00cd6862e1e426c845413515732a204', 'request_id': 'req-18a78616-c66b-47b2-a3d0-1c49732acd59'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:40.490429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:40.510588 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] The token cache is being invalidate because project a00cd6862e1e426c845413515732a204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:13:40.510969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:40.511695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-18a78616-c66b-47b2-a3d0-1c49732acd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:13:40.513527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1277/2543] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:13:40 2022] DELETE /identity/v3/projects/a00cd6862e1e426c845413515732a204 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:13:40.520456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf711b9d-84e2-4d7e-82a1-cc79b5356585 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.520979 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf711b9d-84e2-4d7e-82a1-cc79b5356585 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.521414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf711b9d-84e2-4d7e-82a1-cc79b5356585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.542590 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cf711b9d-84e2-4d7e-82a1-cc79b5356585 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:40.543880 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cf711b9d-84e2-4d7e-82a1-cc79b5356585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:40.598218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:40.610078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1267/2544] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:13:40.618052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588fb4e-0b81-4abc-a62e-3827e5246ba7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.618333 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588fb4e-0b81-4abc-a62e-3827e5246ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.618604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588fb4e-0b81-4abc-a62e-3827e5246ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.638349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1588fb4e-0b81-4abc-a62e-3827e5246ba7 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:40.639673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1588fb4e-0b81-4abc-a62e-3827e5246ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:40.647704 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1278/2545] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:13:40.652025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf711b9d-84e2-4d7e-82a1-cc79b5356585 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:40.662587 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf711b9d-84e2-4d7e-82a1-cc79b5356585 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:40.667195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d254c8-cfda-4c37-8988-371bd0cf66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:40.667793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d254c8-cfda-4c37-8988-371bd0cf66b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.668078 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d254c8-cfda-4c37-8988-371bd0cf66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.668378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d254c8-cfda-4c37-8988-371bd0cf66b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.669028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d254c8-cfda-4c37-8988-371bd0cf66b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:13:40.669335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d254c8-cfda-4c37-8988-371bd0cf66b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:40.671595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d254c8-cfda-4c37-8988-371bd0cf66b7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:40.683097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1268/2546] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:13:40.687671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588fb4e-0b81-4abc-a62e-3827e5246ba7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:40.697094 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588fb4e-0b81-4abc-a62e-3827e5246ba7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:40.701894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130cce6-d9d3-4a9f-89e8-682b16b71ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:40.702499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130cce6-d9d3-4a9f-89e8-682b16b71ecb admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.702781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130cce6-d9d3-4a9f-89e8-682b16b71ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.703069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130cce6-d9d3-4a9f-89e8-682b16b71ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.703707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130cce6-d9d3-4a9f-89e8-682b16b71ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:40.705922 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130cce6-d9d3-4a9f-89e8-682b16b71ecb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:40.735736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1279/2547] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:13:40 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:13:40.740115 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d254c8-cfda-4c37-8988-371bd0cf66b7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:40.750383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d254c8-cfda-4c37-8988-371bd0cf66b7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:40.815032 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304f718-ea61-45f2-8880-0f19379780ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:40.816004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304f718-ea61-45f2-8880-0f19379780ef admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.816549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304f718-ea61-45f2-8880-0f19379780ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.817024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304f718-ea61-45f2-8880-0f19379780ef admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.817893 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304f718-ea61-45f2-8880-0f19379780ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:40.820312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304f718-ea61-45f2-8880-0f19379780ef admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:40.847680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1269/2548] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:13:40 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:13:40.852014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130cce6-d9d3-4a9f-89e8-682b16b71ecb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:40.865819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130cce6-d9d3-4a9f-89e8-682b16b71ecb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:40.870470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad4892-2a39-445b-bdab-71c7fca65c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:40.871073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad4892-2a39-445b-bdab-71c7fca65c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.871351 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad4892-2a39-445b-bdab-71c7fca65c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.871646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad4892-2a39-445b-bdab-71c7fca65c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.872292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad4892-2a39-445b-bdab-71c7fca65c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:40.874079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad4892-2a39-445b-bdab-71c7fca65c0a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:40.885518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1280/2549] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:13:40.890195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304f718-ea61-45f2-8880-0f19379780ef admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:40.900667 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304f718-ea61-45f2-8880-0f19379780ef admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:40.906199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ec968-a589-4f59-8a1e-afb17e78a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:40.906803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ec968-a589-4f59-8a1e-afb17e78a706 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.907114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ec968-a589-4f59-8a1e-afb17e78a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.907390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ec968-a589-4f59-8a1e-afb17e78a706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.908029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ec968-a589-4f59-8a1e-afb17e78a706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:40.909714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ec968-a589-4f59-8a1e-afb17e78a706 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:40.920809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1270/2550] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:13:40.925018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad4892-2a39-445b-bdab-71c7fca65c0a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:40.935104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad4892-2a39-445b-bdab-71c7fca65c0a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:40.939848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3ed67-8ecf-4d02-8485-85f882dd790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:40.940532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3ed67-8ecf-4d02-8485-85f882dd790a admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.940820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3ed67-8ecf-4d02-8485-85f882dd790a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.941095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3ed67-8ecf-4d02-8485-85f882dd790a admin admin] PATH_INFO: `/v3/projects/adf0beb2879143d6826a0337a5f4cbd8/users/ba6fd22af64d4484828441b300a950aa/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.956072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3ed67-8ecf-4d02-8485-85f882dd790a admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf0beb2879143d6826a0337a5f4cbd8, user_id=ba6fd22af64d4484828441b300a950aa, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:40.958756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3ed67-8ecf-4d02-8485-85f882dd790a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:40.972066 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1281/2551] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:13:40 2022] PUT /identity/v3/projects/adf0beb2879143d6826a0337a5f4cbd8/users/ba6fd22af64d4484828441b300a950aa/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:13:40.977197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55160-28bf-4132-aeb6-b74f2aa20e91 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:40.977489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55160-28bf-4132-aeb6-b74f2aa20e91 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:40.977764 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55160-28bf-4132-aeb6-b74f2aa20e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:40.996887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4ab55160-28bf-4132-aeb6-b74f2aa20e91 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:40.998096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4ab55160-28bf-4132-aeb6-b74f2aa20e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:41.057245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1271/2552] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:13:41.068098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3ed67-8ecf-4d02-8485-85f882dd790a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:41.069949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1fd3ed67-8ecf-4d02-8485-85f882dd790a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:41.129372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3ed67-8ecf-4d02-8485-85f882dd790a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:41.133459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f6f1-8f71-4a16-8f0e-04d9b4e52a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:41.134092 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f6f1-8f71-4a16-8f0e-04d9b4e52a75 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:41.134353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f6f1-8f71-4a16-8f0e-04d9b4e52a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:41.134625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f6f1-8f71-4a16-8f0e-04d9b4e52a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:41.145391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f6f1-8f71-4a16-8f0e-04d9b4e52a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:41.146840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f6f1-8f71-4a16-8f0e-04d9b4e52a75 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:41.157546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1282/2553] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:13:45.051697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab55160-28bf-4132-aeb6-b74f2aa20e91 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:45.053226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4ab55160-28bf-4132-aeb6-b74f2aa20e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:45.065582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab55160-28bf-4132-aeb6-b74f2aa20e91 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:45.069728 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f0c8f-b104-4b25-9e2a-7b80eae9766c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:45.070433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0c8f-b104-4b25-9e2a-7b80eae9766c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:45.071031 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0c8f-b104-4b25-9e2a-7b80eae9766c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:45.071465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0c8f-b104-4b25-9e2a-7b80eae9766c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:45.073626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-677f0c8f-b104-4b25-9e2a-7b80eae9766c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:45.083940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f0c8f-b104-4b25-9e2a-7b80eae9766c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:45.085420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f0c8f-b104-4b25-9e2a-7b80eae9766c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:45.094345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1272/2554] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:13:46.093419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dd554-4b95-403f-948d-a702931f5e54 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:46.093957 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dd554-4b95-403f-948d-a702931f5e54 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:46.094183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dd554-4b95-403f-948d-a702931f5e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:46.134328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ad9dd554-4b95-403f-948d-a702931f5e54 None None] MFA Rules not processed for user `ba6fd22af64d4484828441b300a950aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:46.135601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ad9dd554-4b95-403f-948d-a702931f5e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:46.175835 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f0c8f-b104-4b25-9e2a-7b80eae9766c service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:46.177294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-677f0c8f-b104-4b25-9e2a-7b80eae9766c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:46.239230 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:46.257981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1283/2555] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:13:46.266647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f0c8f-b104-4b25-9e2a-7b80eae9766c service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:46.274210 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dd554-4b95-403f-948d-a702931f5e54 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:46.275069 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58602c13-be30-4154-b11c-4ef2c83e2071 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:46.275706 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58602c13-be30-4154-b11c-4ef2c83e2071 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:46.275879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ad9dd554-4b95-403f-948d-a702931f5e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:46.275984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58602c13-be30-4154-b11c-4ef2c83e2071 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:46.276244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58602c13-be30-4154-b11c-4ef2c83e2071 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:46.278235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-58602c13-be30-4154-b11c-4ef2c83e2071 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:46.294852 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58602c13-be30-4154-b11c-4ef2c83e2071 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:46.296750 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58602c13-be30-4154-b11c-4ef2c83e2071 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:46.299732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:13:46.316687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1273/2556] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:13:46.378191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dd554-4b95-403f-948d-a702931f5e54 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:46.387480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c426fc2-1fc9-43b3-9384-2fbd06f8a10c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:46.388478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c426fc2-1fc9-43b3-9384-2fbd06f8a10c service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:46.392647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c426fc2-1fc9-43b3-9384-2fbd06f8a10c service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:46.392967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c426fc2-1fc9-43b3-9384-2fbd06f8a10c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:46.406515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c426fc2-1fc9-43b3-9384-2fbd06f8a10c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:46.408214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c426fc2-1fc9-43b3-9384-2fbd06f8a10c service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:46.419523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1284/2557] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:13:48.223959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff897e-d53a-4edb-8de2-5ddd0203f941 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:48.224574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff897e-d53a-4edb-8de2-5ddd0203f941 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:48.224674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff897e-d53a-4edb-8de2-5ddd0203f941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:48.246186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5fff897e-d53a-4edb-8de2-5ddd0203f941 None None] MFA Rules not processed for user `ba6fd22af64d4484828441b300a950aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:13:48.248220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5fff897e-d53a-4edb-8de2-5ddd0203f941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:48.266585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1274/2558] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:13:49.915294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c426fc2-1fc9-43b3-9384-2fbd06f8a10c service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:49.926208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c426fc2-1fc9-43b3-9384-2fbd06f8a10c service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:49.930163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6580e14-8747-4d33-af4d-5f956659c88c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:49.930956 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6580e14-8747-4d33-af4d-5f956659c88c service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:49.931232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6580e14-8747-4d33-af4d-5f956659c88c service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:49.931680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6580e14-8747-4d33-af4d-5f956659c88c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:49.934266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a6580e14-8747-4d33-af4d-5f956659c88c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:49.947522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6580e14-8747-4d33-af4d-5f956659c88c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:49.949539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6580e14-8747-4d33-af4d-5f956659c88c service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:49.960936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1285/2559] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:13:57.734429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff897e-d53a-4edb-8de2-5ddd0203f941 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:57.744001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff897e-d53a-4edb-8de2-5ddd0203f941 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:57.747554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2951a-ac9c-4c47-9de6-608778b92ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:57.748153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2951a-ac9c-4c47-9de6-608778b92ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:57.748464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2951a-ac9c-4c47-9de6-608778b92ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:57.748740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2951a-ac9c-4c47-9de6-608778b92ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:57.751670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-07a2951a-ac9c-4c47-9de6-608778b92ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:57.815050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2951a-ac9c-4c47-9de6-608778b92ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:57.816519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2951a-ac9c-4c47-9de6-608778b92ea6 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:57.826137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1275/2560] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:13:59.468650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6580e14-8747-4d33-af4d-5f956659c88c service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:13:59.481654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6580e14-8747-4d33-af4d-5f956659c88c service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:13:59.487600 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4549eb7-7ece-4b60-9b5b-51c87d98ec36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:13:59.488208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4549eb7-7ece-4b60-9b5b-51c87d98ec36 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:13:59.488518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4549eb7-7ece-4b60-9b5b-51c87d98ec36 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:13:59.488793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4549eb7-7ece-4b60-9b5b-51c87d98ec36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:13:59.490498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d4549eb7-7ece-4b60-9b5b-51c87d98ec36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:13:59.503703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4549eb7-7ece-4b60-9b5b-51c87d98ec36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:13:59.505321 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4549eb7-7ece-4b60-9b5b-51c87d98ec36 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:13:59.516897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1286/2561] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:13:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:14:00.067017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea6c8-7360-4c8e-be26-6ceccf80f690 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:00.067762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea6c8-7360-4c8e-be26-6ceccf80f690 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:00.067762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea6c8-7360-4c8e-be26-6ceccf80f690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:00.091856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7efea6c8-7360-4c8e-be26-6ceccf80f690 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:14:00.094029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7efea6c8-7360-4c8e-be26-6ceccf80f690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:00.171080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1276/2562] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:14:00.185218 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4549eb7-7ece-4b60-9b5b-51c87d98ec36 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:14:00.187431 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d4549eb7-7ece-4b60-9b5b-51c87d98ec36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:00.302088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4549eb7-7ece-4b60-9b5b-51c87d98ec36 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:14:00.309065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eab285-9257-47c7-9307-e2aaa4600cdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:14:00.309619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab285-9257-47c7-9307-e2aaa4600cdc service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:00.309952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab285-9257-47c7-9307-e2aaa4600cdc service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:00.310235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab285-9257-47c7-9307-e2aaa4600cdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:00.337754 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eab285-9257-47c7-9307-e2aaa4600cdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:14:00.339572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eab285-9257-47c7-9307-e2aaa4600cdc service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:14:00.349981 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1287/2563] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:14:10.158651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=68 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:14:10.346073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=71 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:14:12.372811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efea6c8-7360-4c8e-be26-6ceccf80f690 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:14:12.374519 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7efea6c8-7360-4c8e-be26-6ceccf80f690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:12.392943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efea6c8-7360-4c8e-be26-6ceccf80f690 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:14:12.398354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9162c9f-0e8e-4a01-a2df-f3daf40d5d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:14:12.398968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9162c9f-0e8e-4a01-a2df-f3daf40d5d41 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:12.399253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9162c9f-0e8e-4a01-a2df-f3daf40d5d41 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:12.399534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9162c9f-0e8e-4a01-a2df-f3daf40d5d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:12.401282 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f9162c9f-0e8e-4a01-a2df-f3daf40d5d41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:12.414406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9162c9f-0e8e-4a01-a2df-f3daf40d5d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:14:12.415992 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9162c9f-0e8e-4a01-a2df-f3daf40d5d41 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:14:12.426602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1277/2564] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:14:14.262869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25ab84-7e95-41a4-9628-c391363cc3d8 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:14.263807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25ab84-7e95-41a4-9628-c391363cc3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:14.264086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25ab84-7e95-41a4-9628-c391363cc3d8 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:14.266153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1288/2565] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:14:14.271944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208dbd1-c916-4f12-acf5-b5f98ca0580f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:14.272438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208dbd1-c916-4f12-acf5-b5f98ca0580f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:14.272537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208dbd1-c916-4f12-acf5-b5f98ca0580f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:14.294146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e208dbd1-c916-4f12-acf5-b5f98ca0580f None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:14:14.295355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e208dbd1-c916-4f12-acf5-b5f98ca0580f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:14.304813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1278/2566] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:14:14.317781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25ab84-7e95-41a4-9628-c391363cc3d8 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:14:14.319510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6b25ab84-7e95-41a4-9628-c391363cc3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:14.384350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25ab84-7e95-41a4-9628-c391363cc3d8 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:14:14.388189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b0a27-e51b-4f30-acf8-eeb79648b437 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb70dd34dc642cfbb49b4e1a0434399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:14:14.388973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b0a27-e51b-4f30-acf8-eeb79648b437 service glance] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:14.389415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b0a27-e51b-4f30-acf8-eeb79648b437 service glance] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:14.390466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b0a27-e51b-4f30-acf8-eeb79648b437 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:14.400939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b0a27-e51b-4f30-acf8-eeb79648b437 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:14:14.402362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b0a27-e51b-4f30-acf8-eeb79648b437 service glance] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:14:14.413291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1289/2567] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:14:14.481620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d6f71-e15c-4d9b-b7b4-ec1c9255cfa8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:14.481905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d6f71-e15c-4d9b-b7b4-ec1c9255cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:14.482255 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d6f71-e15c-4d9b-b7b4-ec1c9255cfa8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:14.484465 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1279/2568] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:14:14.489222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2bac-d395-46d7-bd2a-7ae5767dc07e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:14.489511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2bac-d395-46d7-bd2a-7ae5767dc07e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:14.489789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2bac-d395-46d7-bd2a-7ae5767dc07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:14.513806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-bd3b2bac-d395-46d7-bd2a-7ae5767dc07e None None] MFA Rules not processed for user `f6c13711596647178ad3f93865eca187`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:14:14.515953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bd3b2bac-d395-46d7-bd2a-7ae5767dc07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:14.522474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1290/2569] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:14:14.534190 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d6f71-e15c-4d9b-b7b4-ec1c9255cfa8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:14:14.545071 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d6f71-e15c-4d9b-b7b4-ec1c9255cfa8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:14:14.549455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ebc2-51b7-400b-9a19-9a7b4b24f025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:14:14.550044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ebc2-51b7-400b-9a19-9a7b4b24f025 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:14.550324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ebc2-51b7-400b-9a19-9a7b4b24f025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:14.550598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ebc2-51b7-400b-9a19-9a7b4b24f025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:14.557573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ebc2-51b7-400b-9a19-9a7b4b24f025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:14:14.558983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ebc2-51b7-400b-9a19-9a7b4b24f025 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:14:14.567622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1280/2570] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:14:14.650121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5bc2b-38e8-4c7a-8abb-15471b9b4856 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:14.650422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5bc2b-38e8-4c7a-8abb-15471b9b4856 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:14.650699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5bc2b-38e8-4c7a-8abb-15471b9b4856 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:14.652034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1291/2571] 10.222.0.83 () {54 vars in 921 bytes} [Wed Aug 31 01:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 01:14:14.658427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288909c6-f08f-494b-9f21-bf8b3dc870ac None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:14.658747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288909c6-f08f-494b-9f21-bf8b3dc870ac None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:14.659030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288909c6-f08f-494b-9f21-bf8b3dc870ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:14.679182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-288909c6-f08f-494b-9f21-bf8b3dc870ac None None] MFA Rules not processed for user `a99d74d9d72c4fc2a363ce6559e4ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:14:14.680671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-288909c6-f08f-494b-9f21-bf8b3dc870ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:14.690730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1281/2572] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Aug 31 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:14:14.701063 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5bc2b-38e8-4c7a-8abb-15471b9b4856 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:14:14.712413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5bc2b-38e8-4c7a-8abb-15471b9b4856 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:14:14.716132 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726447c-16dd-4a40-9002-a682cd57e36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:14:14.716770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726447c-16dd-4a40-9002-a682cd57e36e service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:14.717052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726447c-16dd-4a40-9002-a682cd57e36e service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:14.717381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726447c-16dd-4a40-9002-a682cd57e36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:14.728030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726447c-16dd-4a40-9002-a682cd57e36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:14:14.729494 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726447c-16dd-4a40-9002-a682cd57e36e service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:14:14.740641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1292/2573] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:14:16.552542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b7c88-b099-4fee-b8ba-59db9256a1f9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:16.553046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b7c88-b099-4fee-b8ba-59db9256a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:16.553154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b7c88-b099-4fee-b8ba-59db9256a1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:16.572520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f49b7c88-b099-4fee-b8ba-59db9256a1f9 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:14:16.573712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f49b7c88-b099-4fee-b8ba-59db9256a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:16.582008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1282/2574] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:14:16.605380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726447c-16dd-4a40-9002-a682cd57e36e service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:14:16.616498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726447c-16dd-4a40-9002-a682cd57e36e service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:14:16.621516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ab7c-3736-4abd-abdd-89516ea64b60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:14:16.622121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ab7c-3736-4abd-abdd-89516ea64b60 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:16.622401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ab7c-3736-4abd-abdd-89516ea64b60 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:16.622677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ab7c-3736-4abd-abdd-89516ea64b60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:16.631848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1ab7c-3736-4abd-abdd-89516ea64b60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:14:16.633457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1ab7c-3736-4abd-abdd-89516ea64b60 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:14:16.642788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1293/2575] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:14:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:14:26.567234 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=21 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:14:26.638650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=41 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:14:31.931762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220bd2b-e8bc-4ebb-a08e-39cc5da1b46c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:31.932246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220bd2b-e8bc-4ebb-a08e-39cc5da1b46c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:31.932366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220bd2b-e8bc-4ebb-a08e-39cc5da1b46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:31.952290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6220bd2b-e8bc-4ebb-a08e-39cc5da1b46c None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:14:31.953520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6220bd2b-e8bc-4ebb-a08e-39cc5da1b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:31.960939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1283/2576] 10.222.0.83 () {58 vars in 967 bytes} [Wed Aug 31 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:14:31.973196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ab7c-3736-4abd-abdd-89516ea64b60 service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:14:31.983690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ab7c-3736-4abd-abdd-89516ea64b60 service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:14:31.989372 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413b0c7-4a1f-4bac-82b8-1d47d4e6ba52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:14:31.989968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b0c7-4a1f-4bac-82b8-1d47d4e6ba52 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:31.990252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b0c7-4a1f-4bac-82b8-1d47d4e6ba52 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:31.990527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b0c7-4a1f-4bac-82b8-1d47d4e6ba52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:31.998454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413b0c7-4a1f-4bac-82b8-1d47d4e6ba52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:14:32.000029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413b0c7-4a1f-4bac-82b8-1d47d4e6ba52 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:14:32.008681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1294/2577] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:14:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:14:41.946907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:14:42.005401 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:14:50.720080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba113b6-21d6-4cf8-8ed2-e996045cf096 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:50.720770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba113b6-21d6-4cf8-8ed2-e996045cf096 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:50.720770 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba113b6-21d6-4cf8-8ed2-e996045cf096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:50.739856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0ba113b6-21d6-4cf8-8ed2-e996045cf096 None None] MFA Rules not processed for user `ba6fd22af64d4484828441b300a950aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:14:50.741077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0ba113b6-21d6-4cf8-8ed2-e996045cf096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:50.747785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1284/2578] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:14:51.051951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413b0c7-4a1f-4bac-82b8-1d47d4e6ba52 service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:14:51.061040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413b0c7-4a1f-4bac-82b8-1d47d4e6ba52 service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:14:51.065188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0815ab-566e-4336-b485-560e229ce484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:14:51.065777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0815ab-566e-4336-b485-560e229ce484 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:51.066055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0815ab-566e-4336-b485-560e229ce484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:51.066325 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0815ab-566e-4336-b485-560e229ce484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:51.068010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6d0815ab-566e-4336-b485-560e229ce484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:51.077377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0815ab-566e-4336-b485-560e229ce484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:14:51.079629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0815ab-566e-4336-b485-560e229ce484 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:14:51.087577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1295/2579] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:14:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:14:54.188020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba113b6-21d6-4cf8-8ed2-e996045cf096 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:14:54.202147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba113b6-21d6-4cf8-8ed2-e996045cf096 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:14:54.209285 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160461e0-7907-41d7-ad58-e9b7c43cfac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:14:54.209990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160461e0-7907-41d7-ad58-e9b7c43cfac1 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:14:54.210193 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160461e0-7907-41d7-ad58-e9b7c43cfac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:14:54.210678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160461e0-7907-41d7-ad58-e9b7c43cfac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:14:54.212534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-160461e0-7907-41d7-ad58-e9b7c43cfac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:14:54.225403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160461e0-7907-41d7-ad58-e9b7c43cfac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:14:54.228110 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160461e0-7907-41d7-ad58-e9b7c43cfac1 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:14:54.238582 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1285/2580] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:15:01.083938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:04.233375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=9 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:18.423738 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0815ab-566e-4336-b485-560e229ce484 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:18.432483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0815ab-566e-4336-b485-560e229ce484 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:18.436042 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcaca3-c203-4009-9ecb-0df9068ed234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:18.436686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcaca3-c203-4009-9ecb-0df9068ed234 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:18.436976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcaca3-c203-4009-9ecb-0df9068ed234 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:18.437257 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcaca3-c203-4009-9ecb-0df9068ed234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:18.439173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dbfcaca3-c203-4009-9ecb-0df9068ed234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:18.450761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcaca3-c203-4009-9ecb-0df9068ed234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:18.452164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcaca3-c203-4009-9ecb-0df9068ed234 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:18.462717 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1296/2581] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:15:21.539499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160461e0-7907-41d7-ad58-e9b7c43cfac1 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:21.541016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-160461e0-7907-41d7-ad58-e9b7c43cfac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:21.554947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160461e0-7907-41d7-ad58-e9b7c43cfac1 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:21.559990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea9667-6356-49c5-85fc-114c7a968684 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:21.560617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea9667-6356-49c5-85fc-114c7a968684 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:21.560899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea9667-6356-49c5-85fc-114c7a968684 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:21.561175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea9667-6356-49c5-85fc-114c7a968684 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:21.562966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-55ea9667-6356-49c5-85fc-114c7a968684 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:21.575975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea9667-6356-49c5-85fc-114c7a968684 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:21.579000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea9667-6356-49c5-85fc-114c7a968684 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:21.592142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcaca3-c203-4009-9ecb-0df9068ed234 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:21.594681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dbfcaca3-c203-4009-9ecb-0df9068ed234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:21.600457 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1286/2582] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:15:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:15:21.611604 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcaca3-c203-4009-9ecb-0df9068ed234 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:21.616486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:21.617195 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:21.617552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:21.618104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] PATH_INFO: `/v3/users/f7eebe335f274e7aaabb0266583caf89` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:21.619297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7eebe335f274e7aaabb0266583caf89)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:21.621387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:21.669565 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7eebe335f274e7aaabb0266583caf89'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:15:21.670269 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7eebe335f274e7aaabb0266583caf89'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:15:21.677923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7eebe335f274e7aaabb0266583caf89'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:15:21.685131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7eebe335f274e7aaabb0266583caf89'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:15:21.697458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a3388c87-88a8-452d-b7c0-2d4348dff316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7eebe335f274e7aaabb0266583caf89'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:15:21.704144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1297/2583] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:15:21 2022] DELETE /identity/v3/users/f7eebe335f274e7aaabb0266583caf89 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:15:21.880387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea9667-6356-49c5-85fc-114c7a968684 service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:21.892099 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea9667-6356-49c5-85fc-114c7a968684 service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:21.949017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:21.949586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:21.949870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:21.950153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] PATH_INFO: `/v3/projects/69b851966d024f7ca6f652a741d50c9b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:21.951274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b851966d024f7ca6f652a741d50c9b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:21.953917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:22.000403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b851966d024f7ca6f652a741d50c9b', 'request_id': 'req-63261a5c-790a-40dc-a170-22531faae26e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:15:22.005826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b851966d024f7ca6f652a741d50c9b', 'request_id': 'req-63261a5c-790a-40dc-a170-22531faae26e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:15:22.012791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b851966d024f7ca6f652a741d50c9b', 'request_id': 'req-63261a5c-790a-40dc-a170-22531faae26e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:15:22.024003 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] The token cache is being invalidate because project 69b851966d024f7ca6f652a741d50c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:15:22.024291 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:15:22.024931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-63261a5c-790a-40dc-a170-22531faae26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:15:22.026491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1287/2584] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:15:21 2022] DELETE /identity/v3/projects/69b851966d024f7ca6f652a741d50c9b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:15:22.031853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341b66a-6d45-4a52-a289-1696ee008ee6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:22.032136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341b66a-6d45-4a52-a289-1696ee008ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:22.032441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341b66a-6d45-4a52-a289-1696ee008ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:22.052276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6341b66a-6d45-4a52-a289-1696ee008ee6 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:15:22.053514 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6341b66a-6d45-4a52-a289-1696ee008ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:22.118909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1298/2585] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:15:22.130025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb62cb-d346-4836-92c0-043b0cf1377a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:22.130754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb62cb-d346-4836-92c0-043b0cf1377a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:22.131131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb62cb-d346-4836-92c0-043b0cf1377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:22.152242 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-05eb62cb-d346-4836-92c0-043b0cf1377a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:15:22.153506 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-05eb62cb-d346-4836-92c0-043b0cf1377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:22.162181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1288/2586] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:15:22.166657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341b66a-6d45-4a52-a289-1696ee008ee6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:22.178585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341b66a-6d45-4a52-a289-1696ee008ee6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:22.183313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687046-a384-4320-aee9-d5743cb8780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:22.183921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687046-a384-4320-aee9-d5743cb8780a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:22.184206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687046-a384-4320-aee9-d5743cb8780a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:22.184525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687046-a384-4320-aee9-d5743cb8780a admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:22.185177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687046-a384-4320-aee9-d5743cb8780a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:15:22.185485 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687046-a384-4320-aee9-d5743cb8780a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:22.187647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687046-a384-4320-aee9-d5743cb8780a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:22.199085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1299/2587] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:15:22.203925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb62cb-d346-4836-92c0-043b0cf1377a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:22.213101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb62cb-d346-4836-92c0-043b0cf1377a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:22.217730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6e6b-88c6-4c66-8ee9-68e659b8dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:22.218350 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6e6b-88c6-4c66-8ee9-68e659b8dead admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:22.218756 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6e6b-88c6-4c66-8ee9-68e659b8dead admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:22.219043 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6e6b-88c6-4c66-8ee9-68e659b8dead admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:22.219683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c6e6b-88c6-4c66-8ee9-68e659b8dead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:22.221593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c6e6b-88c6-4c66-8ee9-68e659b8dead admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:22.249059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1289/2588] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:15:22 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:15:22.253819 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687046-a384-4320-aee9-d5743cb8780a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:22.263895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687046-a384-4320-aee9-d5743cb8780a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:22.306893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:22.322584 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3bad4-063d-44b3-bb52-dfb015ef65c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:22.323214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3bad4-063d-44b3-bb52-dfb015ef65c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:22.323496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3bad4-063d-44b3-bb52-dfb015ef65c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:22.323775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3bad4-063d-44b3-bb52-dfb015ef65c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:22.324485 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3bad4-063d-44b3-bb52-dfb015ef65c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:22.326402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3bad4-063d-44b3-bb52-dfb015ef65c9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:22.347232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1300/2589] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:15:22 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:15:22.351363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6e6b-88c6-4c66-8ee9-68e659b8dead admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:22.362494 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6e6b-88c6-4c66-8ee9-68e659b8dead admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:22.367153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e5c3e-866c-4e19-ba8d-de7836b0b343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:22.367757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e5c3e-866c-4e19-ba8d-de7836b0b343 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:22.368044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e5c3e-866c-4e19-ba8d-de7836b0b343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:22.368355 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e5c3e-866c-4e19-ba8d-de7836b0b343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:22.369005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e5c3e-866c-4e19-ba8d-de7836b0b343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:22.370595 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e5c3e-866c-4e19-ba8d-de7836b0b343 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:22.380725 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1290/2590] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:15:22.384676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3bad4-063d-44b3-bb52-dfb015ef65c9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:22.394670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3bad4-063d-44b3-bb52-dfb015ef65c9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:22.399311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e5ac7-fb18-407e-a4da-10e0e68b74f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:22.399909 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5ac7-fb18-407e-a4da-10e0e68b74f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:22.400191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5ac7-fb18-407e-a4da-10e0e68b74f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:22.400498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5ac7-fb18-407e-a4da-10e0e68b74f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:22.401137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e5ac7-fb18-407e-a4da-10e0e68b74f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:22.402723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e5ac7-fb18-407e-a4da-10e0e68b74f2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:22.413834 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1301/2591] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:15:22.418077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e5c3e-866c-4e19-ba8d-de7836b0b343 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:22.428548 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e5c3e-866c-4e19-ba8d-de7836b0b343 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:22.433254 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483156a-243e-4611-8edf-a54beca7fd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:22.433894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483156a-243e-4611-8edf-a54beca7fd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:22.434174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483156a-243e-4611-8edf-a54beca7fd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:22.434447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483156a-243e-4611-8edf-a54beca7fd07 admin admin] PATH_INFO: `/v3/projects/419aeaadadd04744bf0e92580d06252b/users/a7607c50966b458696e4ab9c741deef6/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:22.448584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483156a-243e-4611-8edf-a54beca7fd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=419aeaadadd04744bf0e92580d06252b, user_id=a7607c50966b458696e4ab9c741deef6, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:22.451259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483156a-243e-4611-8edf-a54beca7fd07 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:22.463843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1291/2592] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:15:22 2022] PUT /identity/v3/projects/419aeaadadd04744bf0e92580d06252b/users/a7607c50966b458696e4ab9c741deef6/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:15:22.469371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029c57-1989-4985-988b-208ebb1a047d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:22.469662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029c57-1989-4985-988b-208ebb1a047d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:22.469941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029c57-1989-4985-988b-208ebb1a047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:22.489148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-85029c57-1989-4985-988b-208ebb1a047d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:15:22.490344 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-85029c57-1989-4985-988b-208ebb1a047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:22.548187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1302/2593] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:15:22.557752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483156a-243e-4611-8edf-a54beca7fd07 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:22.559444 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8483156a-243e-4611-8edf-a54beca7fd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:22.574226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:22.619121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483156a-243e-4611-8edf-a54beca7fd07 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:22.622797 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156d561-8384-48c7-af70-0a01248acc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:22.623400 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156d561-8384-48c7-af70-0a01248acc98 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:22.623677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156d561-8384-48c7-af70-0a01248acc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:22.623949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156d561-8384-48c7-af70-0a01248acc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:22.633240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156d561-8384-48c7-af70-0a01248acc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:22.634673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156d561-8384-48c7-af70-0a01248acc98 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:22.643992 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1292/2594] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:15:26.671964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b8aaf-403d-4644-81a5-87ff92c4a362 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:26.672640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b8aaf-403d-4644-81a5-87ff92c4a362 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:26.672640 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b8aaf-403d-4644-81a5-87ff92c4a362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:26.704260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-385b8aaf-403d-4644-81a5-87ff92c4a362 None None] MFA Rules not processed for user `a7607c50966b458696e4ab9c741deef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:15:26.705504 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-385b8aaf-403d-4644-81a5-87ff92c4a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:26.785074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1303/2595] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:15:26.801383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156d561-8384-48c7-af70-0a01248acc98 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:15:26.802883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0156d561-8384-48c7-af70-0a01248acc98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:26.880720 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156d561-8384-48c7-af70-0a01248acc98 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:15:26.886643 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5006-d985-485a-af41-0f9989c0c0fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:15:26.887274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5006-d985-485a-af41-0f9989c0c0fc service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:26.887589 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5006-d985-485a-af41-0f9989c0c0fc service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:26.887868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5006-d985-485a-af41-0f9989c0c0fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:26.896757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd5006-d985-485a-af41-0f9989c0c0fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:15:26.898391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd5006-d985-485a-af41-0f9989c0c0fc service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:15:26.908736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1293/2596] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:15:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:15:28.459098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d64c-fb52-43c4-9e13-5d7bf387d723 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:28.459642 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d64c-fb52-43c4-9e13-5d7bf387d723 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:28.459746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d64c-fb52-43c4-9e13-5d7bf387d723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:28.478836 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7e64d64c-fb52-43c4-9e13-5d7bf387d723 None None] MFA Rules not processed for user `a7607c50966b458696e4ab9c741deef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:15:28.480040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7e64d64c-fb52-43c4-9e13-5d7bf387d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:28.487666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1304/2597] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:15:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:15:36.903471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=54 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:38.473824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:52.356082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4b89c-fb56-4f22-8399-ac5cbeba6bbd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:15:52.356598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4b89c-fb56-4f22-8399-ac5cbeba6bbd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:15:52.356698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4b89c-fb56-4f22-8399-ac5cbeba6bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:15:52.376122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5bb4b89c-fb56-4f22-8399-ac5cbeba6bbd None None] MFA Rules not processed for user `ba6fd22af64d4484828441b300a950aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:15:52.377394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5bb4b89c-fb56-4f22-8399-ac5cbeba6bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:15:52.431277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1294/2598] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:16:02.424985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=25 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:16:39.725777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64d64c-fb52-43c4-9e13-5d7bf387d723 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:16:39.727180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7e64d64c-fb52-43c4-9e13-5d7bf387d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:16:39.865925 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64d64c-fb52-43c4-9e13-5d7bf387d723 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:16:39.870968 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ff6a0-268e-4261-adb7-f0f678aa2eb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:16:39.871576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ff6a0-268e-4261-adb7-f0f678aa2eb2 service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:16:39.871859 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ff6a0-268e-4261-adb7-f0f678aa2eb2 service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:16:39.872134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ff6a0-268e-4261-adb7-f0f678aa2eb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:16:39.873904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-636ff6a0-268e-4261-adb7-f0f678aa2eb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:16:39.885774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ff6a0-268e-4261-adb7-f0f678aa2eb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:16:39.887460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ff6a0-268e-4261-adb7-f0f678aa2eb2 service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:16:39.897972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1305/2599] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:16:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:16:49.893103 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=63 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:16:59.840738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf125-5ee6-4828-bf9d-a7e7868adbd0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:16:59.841290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf125-5ee6-4828-bf9d-a7e7868adbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:16:59.841409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf125-5ee6-4828-bf9d-a7e7868adbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:16:59.860752 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b2eaf125-5ee6-4828-bf9d-a7e7868adbd0 None None] MFA Rules not processed for user `ba6fd22af64d4484828441b300a950aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:16:59.862020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b2eaf125-5ee6-4828-bf9d-a7e7868adbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:16:59.869568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1295/2600] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:17:09.855184 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:17:56.693616 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ff6a0-268e-4261-adb7-f0f678aa2eb2 service placement] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:17:56.708217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ff6a0-268e-4261-adb7-f0f678aa2eb2 service placement] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:17:56.714363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cd320-a676-4765-a0be-e19d3d068e5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:17:56.714988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cd320-a676-4765-a0be-e19d3d068e5f service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:17:56.715446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cd320-a676-4765-a0be-e19d3d068e5f service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:17:56.716419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cd320-a676-4765-a0be-e19d3d068e5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:17:56.718918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a73cd320-a676-4765-a0be-e19d3d068e5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:17:56.732187 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cd320-a676-4765-a0be-e19d3d068e5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:17:56.734377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cd320-a676-4765-a0be-e19d3d068e5f service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:17:56.751796 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1306/2601] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:17:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:01.256415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaf125-5ee6-4828-bf9d-a7e7868adbd0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:01.257848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b2eaf125-5ee6-4828-bf9d-a7e7868adbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:01.309023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaf125-5ee6-4828-bf9d-a7e7868adbd0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:01.313738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:01.314357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:01.314637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:01.314913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] PATH_INFO: `/v3/users/d57322ee61ad44efb335a38e449d61f6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:01.316074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57322ee61ad44efb335a38e449d61f6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:01.318025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:01.370931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57322ee61ad44efb335a38e449d61f6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.371687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57322ee61ad44efb335a38e449d61f6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.378588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57322ee61ad44efb335a38e449d61f6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.391012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57322ee61ad44efb335a38e449d61f6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.399262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57322ee61ad44efb335a38e449d61f6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.406063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1296/2602] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:01 2022] DELETE /identity/v3/users/d57322ee61ad44efb335a38e449d61f6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:01.582238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cd320-a676-4765-a0be-e19d3d068e5f service placement] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:01.599252 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cd320-a676-4765-a0be-e19d3d068e5f service placement] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:01.656967 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:01.657422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:01.657878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:01.658128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] PATH_INFO: `/v3/projects/972c64cebc2b4f3aabaf685d25b49112` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:01.659301 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=972c64cebc2b4f3aabaf685d25b49112)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:01.661267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:01.708381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972c64cebc2b4f3aabaf685d25b49112', 'request_id': 'req-c172b755-9327-45a4-baf7-364d2d0745d4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.714342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972c64cebc2b4f3aabaf685d25b49112', 'request_id': 'req-c172b755-9327-45a4-baf7-364d2d0745d4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.720955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972c64cebc2b4f3aabaf685d25b49112', 'request_id': 'req-c172b755-9327-45a4-baf7-364d2d0745d4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.733213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] The token cache is being invalidate because project 972c64cebc2b4f3aabaf685d25b49112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:01.733512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.734135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.735619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1307/2603] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:01 2022] DELETE /identity/v3/projects/972c64cebc2b4f3aabaf685d25b49112 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:01.739873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:01.741305 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:01.755117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093930ca-aaf1-49a5-a54d-2371e578403a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:01.813741 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:01.814402 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:01.814668 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:01.814945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] PATH_INFO: `/v3/users/7dfab3f5a0ec44a6a8fea66e027b98c8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:01.816095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dfab3f5a0ec44a6a8fea66e027b98c8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:01.818058 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:01.864532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:01.866191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dfab3f5a0ec44a6a8fea66e027b98c8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.866857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dfab3f5a0ec44a6a8fea66e027b98c8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.874849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dfab3f5a0ec44a6a8fea66e027b98c8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.887799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dfab3f5a0ec44a6a8fea66e027b98c8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.894499 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dfab3f5a0ec44a6a8fea66e027b98c8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:01.901113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1297/2604] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:01 2022] DELETE /identity/v3/users/7dfab3f5a0ec44a6a8fea66e027b98c8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:02.071734 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:02.074109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:02.090316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172b755-9327-45a4-baf7-364d2d0745d4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:02.158322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:02.158976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:02.159262 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:02.159542 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] PATH_INFO: `/v3/projects/f10fbb67963f45188abb413f0e7f6f3d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:02.160832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10fbb67963f45188abb413f0e7f6f3d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:02.162934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:02.187895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:02.218282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10fbb67963f45188abb413f0e7f6f3d', 'request_id': 'req-09fe333b-e802-4b86-9b67-e316f99fd141'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:02.224798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10fbb67963f45188abb413f0e7f6f3d', 'request_id': 'req-09fe333b-e802-4b86-9b67-e316f99fd141'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:02.231260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10fbb67963f45188abb413f0e7f6f3d', 'request_id': 'req-09fe333b-e802-4b86-9b67-e316f99fd141'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:02.247533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] The token cache is being invalidate because project f10fbb67963f45188abb413f0e7f6f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:02.247830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:02.248510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:02.249974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1308/2605] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:02 2022] DELETE /identity/v3/projects/f10fbb67963f45188abb413f0e7f6f3d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:07.942485 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:07.943912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:07.958322 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818c61-7e0c-49c1-b3fc-37917ed2acd5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:08.014533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:08.015168 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.015453 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.015730 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] PATH_INFO: `/v3/users/ba6fd22af64d4484828441b300a950aa` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.016907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6fd22af64d4484828441b300a950aa)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:08.018828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:08.063913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6fd22af64d4484828441b300a950aa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:08.064528 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6fd22af64d4484828441b300a950aa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:08.071617 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6fd22af64d4484828441b300a950aa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:08.083966 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6fd22af64d4484828441b300a950aa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:08.091165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-049bb4a2-822b-4a79-a319-b8c7c9192ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6fd22af64d4484828441b300a950aa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:08.096917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1298/2606] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:07 2022] DELETE /identity/v3/users/ba6fd22af64d4484828441b300a950aa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:08.273454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:08.274948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:08.291648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe333b-e802-4b86-9b67-e316f99fd141 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:08.349747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:08.350413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.350692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.350963 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] PATH_INFO: `/v3/projects/adf0beb2879143d6826a0337a5f4cbd8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.352078 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf0beb2879143d6826a0337a5f4cbd8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:08.354289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:08.401211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf0beb2879143d6826a0337a5f4cbd8', 'request_id': 'req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:08.407088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf0beb2879143d6826a0337a5f4cbd8', 'request_id': 'req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:08.413221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf0beb2879143d6826a0337a5f4cbd8', 'request_id': 'req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:08.426385 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] The token cache is being invalidate because project adf0beb2879143d6826a0337a5f4cbd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:08.426676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:08.427289 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-aea19336-b9c6-4fb6-a561-f221c9b6ee9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:08.428798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1309/2607] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:08 2022] DELETE /identity/v3/projects/adf0beb2879143d6826a0337a5f4cbd8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:08.434246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d36e-25f3-4dd8-8634-c984404c30ba None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.434525 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d36e-25f3-4dd8-8634-c984404c30ba None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.434829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d36e-25f3-4dd8-8634-c984404c30ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.493796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5d69d36e-25f3-4dd8-8634-c984404c30ba None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:08.494898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d69d36e-25f3-4dd8-8634-c984404c30ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:08.500292 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:08.555387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1299/2608] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:18:08.563282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9479e09-aa2a-44d0-bfa9-c9dcb6eb9f6a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.563617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9479e09-aa2a-44d0-bfa9-c9dcb6eb9f6a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.563893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9479e09-aa2a-44d0-bfa9-c9dcb6eb9f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.583975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e9479e09-aa2a-44d0-bfa9-c9dcb6eb9f6a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:08.585205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e9479e09-aa2a-44d0-bfa9-c9dcb6eb9f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:08.593766 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1310/2609] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:08.598056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d36e-25f3-4dd8-8634-c984404c30ba None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:08.608013 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d36e-25f3-4dd8-8634-c984404c30ba None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:08.612751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753b29b-9b3d-40a2-b795-3fd881037672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:08.613352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753b29b-9b3d-40a2-b795-3fd881037672 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.613636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753b29b-9b3d-40a2-b795-3fd881037672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.613912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753b29b-9b3d-40a2-b795-3fd881037672 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.614607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753b29b-9b3d-40a2-b795-3fd881037672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:18:08.614913 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753b29b-9b3d-40a2-b795-3fd881037672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:08.616530 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753b29b-9b3d-40a2-b795-3fd881037672 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:08.627824 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1300/2610] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:18:08.632235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9479e09-aa2a-44d0-bfa9-c9dcb6eb9f6a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:08.642222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9479e09-aa2a-44d0-bfa9-c9dcb6eb9f6a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:08.646948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab4c83-f187-4d9b-97f8-41475a99a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:08.647544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4c83-f187-4d9b-97f8-41475a99a7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.647825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4c83-f187-4d9b-97f8-41475a99a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.648098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4c83-f187-4d9b-97f8-41475a99a7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.648777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab4c83-f187-4d9b-97f8-41475a99a7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:08.650681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab4c83-f187-4d9b-97f8-41475a99a7e3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:08.677687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1311/2611] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:08 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:08.681862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753b29b-9b3d-40a2-b795-3fd881037672 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:08.692473 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753b29b-9b3d-40a2-b795-3fd881037672 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:08.749995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015d961-87dc-4f4f-abb0-0402d722ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:08.750532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015d961-87dc-4f4f-abb0-0402d722ed52 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.750816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015d961-87dc-4f4f-abb0-0402d722ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.751096 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015d961-87dc-4f4f-abb0-0402d722ed52 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.751736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015d961-87dc-4f4f-abb0-0402d722ed52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:08.753693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015d961-87dc-4f4f-abb0-0402d722ed52 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:08.774753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1301/2612] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:08 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:18:08.779586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab4c83-f187-4d9b-97f8-41475a99a7e3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:08.789846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab4c83-f187-4d9b-97f8-41475a99a7e3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:08.795156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78956110-dd9d-4b31-ad2a-dd52ca3c92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:08.795755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956110-dd9d-4b31-ad2a-dd52ca3c92fe admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.796045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956110-dd9d-4b31-ad2a-dd52ca3c92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.796343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956110-dd9d-4b31-ad2a-dd52ca3c92fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.796991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78956110-dd9d-4b31-ad2a-dd52ca3c92fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:08.798591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78956110-dd9d-4b31-ad2a-dd52ca3c92fe admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:08.800622 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:08.811212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1312/2613] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:08.815037 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015d961-87dc-4f4f-abb0-0402d722ed52 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:08.825508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015d961-87dc-4f4f-abb0-0402d722ed52 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:08.830627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fe8a8-6a54-4af7-831f-90d52fe5fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:08.831218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fe8a8-6a54-4af7-831f-90d52fe5fb9b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.831500 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fe8a8-6a54-4af7-831f-90d52fe5fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.831776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fe8a8-6a54-4af7-831f-90d52fe5fb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.832450 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fe8a8-6a54-4af7-831f-90d52fe5fb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:08.834051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fe8a8-6a54-4af7-831f-90d52fe5fb9b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:08.844904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1302/2614] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:08.849028 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78956110-dd9d-4b31-ad2a-dd52ca3c92fe admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:08.859805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78956110-dd9d-4b31-ad2a-dd52ca3c92fe admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:08.864538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4876aaf-622d-4dd6-b481-f8cbde5c51eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:08.865192 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4876aaf-622d-4dd6-b481-f8cbde5c51eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.865480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4876aaf-622d-4dd6-b481-f8cbde5c51eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.865764 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4876aaf-622d-4dd6-b481-f8cbde5c51eb admin admin] PATH_INFO: `/v3/projects/8469af0be74549cbb73f018d6f223306/users/c00d4a1ef18e4385be21bce16ea397bf/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.880783 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4876aaf-622d-4dd6-b481-f8cbde5c51eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8469af0be74549cbb73f018d6f223306, user_id=c00d4a1ef18e4385be21bce16ea397bf, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:08.883455 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4876aaf-622d-4dd6-b481-f8cbde5c51eb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:08.895946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1313/2615] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:08 2022] PUT /identity/v3/projects/8469af0be74549cbb73f018d6f223306/users/c00d4a1ef18e4385be21bce16ea397bf/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:08.906989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08874-2533-4aad-8f24-091c5ad85e2e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:08.907321 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08874-2533-4aad-8f24-091c5ad85e2e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:08.907599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08874-2533-4aad-8f24-091c5ad85e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:08.935591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bde08874-2533-4aad-8f24-091c5ad85e2e None None] MFA Rules not processed for user `c00d4a1ef18e4385be21bce16ea397bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:08.936847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bde08874-2533-4aad-8f24-091c5ad85e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:08.999647 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1303/2616] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:09.004238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4876aaf-622d-4dd6-b481-f8cbde5c51eb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:09.065847 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4876aaf-622d-4dd6-b481-f8cbde5c51eb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:09.070625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7ef9b-027b-46f8-9999-e8ef07d28c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:09.071228 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7ef9b-027b-46f8-9999-e8ef07d28c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:09.071541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7ef9b-027b-46f8-9999-e8ef07d28c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:09.071822 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7ef9b-027b-46f8-9999-e8ef07d28c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:09.072478 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7ef9b-027b-46f8-9999-e8ef07d28c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:09.075229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7ef9b-027b-46f8-9999-e8ef07d28c92 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:09.101576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1314/2617] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:09 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:09.105786 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde08874-2533-4aad-8f24-091c5ad85e2e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:09.116747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde08874-2533-4aad-8f24-091c5ad85e2e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:09.120276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:09.175988 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318717c-3809-4e34-9b15-c06c3b166950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:09.176642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318717c-3809-4e34-9b15-c06c3b166950 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:09.176918 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318717c-3809-4e34-9b15-c06c3b166950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:09.177186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318717c-3809-4e34-9b15-c06c3b166950 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:09.177810 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318717c-3809-4e34-9b15-c06c3b166950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:09.179742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318717c-3809-4e34-9b15-c06c3b166950 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:09.200777 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1304/2618] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:09 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:09.205240 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7ef9b-027b-46f8-9999-e8ef07d28c92 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:09.216209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7ef9b-027b-46f8-9999-e8ef07d28c92 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:09.220912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50078a-5b87-474d-a6e8-ed2f571c035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:09.221511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50078a-5b87-474d-a6e8-ed2f571c035b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:09.221791 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50078a-5b87-474d-a6e8-ed2f571c035b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:09.222064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50078a-5b87-474d-a6e8-ed2f571c035b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:09.222702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50078a-5b87-474d-a6e8-ed2f571c035b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:09.224283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50078a-5b87-474d-a6e8-ed2f571c035b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:09.236527 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1315/2619] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:09.240849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318717c-3809-4e34-9b15-c06c3b166950 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:09.250995 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318717c-3809-4e34-9b15-c06c3b166950 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:09.255626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94de274-78e7-4777-baaf-c9ce2dfaa287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:09.256286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94de274-78e7-4777-baaf-c9ce2dfaa287 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:09.256820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94de274-78e7-4777-baaf-c9ce2dfaa287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:09.257101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94de274-78e7-4777-baaf-c9ce2dfaa287 admin admin] PATH_INFO: `/v3/projects/7d437841cc9b48539bfbb8f3ccabf0db/users/e90ca1492ca14438a6744d3d1714e8c0/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:09.272228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94de274-78e7-4777-baaf-c9ce2dfaa287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d437841cc9b48539bfbb8f3ccabf0db, user_id=e90ca1492ca14438a6744d3d1714e8c0, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:09.274892 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94de274-78e7-4777-baaf-c9ce2dfaa287 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:09.289466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1305/2620] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:09 2022] PUT /identity/v3/projects/7d437841cc9b48539bfbb8f3ccabf0db/users/e90ca1492ca14438a6744d3d1714e8c0/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:09.293651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50078a-5b87-474d-a6e8-ed2f571c035b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:09.304229 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50078a-5b87-474d-a6e8-ed2f571c035b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:09.359379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f43c0-000e-4f6c-8553-30132ea7e645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:09.360025 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f43c0-000e-4f6c-8553-30132ea7e645 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:09.360414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f43c0-000e-4f6c-8553-30132ea7e645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:09.360736 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f43c0-000e-4f6c-8553-30132ea7e645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:09.361383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f43c0-000e-4f6c-8553-30132ea7e645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:09.362992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f43c0-000e-4f6c-8553-30132ea7e645 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:09.372820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1316/2621] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:18:09.377089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94de274-78e7-4777-baaf-c9ce2dfaa287 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:09.387782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94de274-78e7-4777-baaf-c9ce2dfaa287 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:09.392405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e553fc-417e-4376-bf81-44aa4cff3f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:09.393050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e553fc-417e-4376-bf81-44aa4cff3f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:09.393335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e553fc-417e-4376-bf81-44aa4cff3f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:09.393612 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e553fc-417e-4376-bf81-44aa4cff3f89 admin admin] PATH_INFO: `/v3/projects/7d437841cc9b48539bfbb8f3ccabf0db/users/e90ca1492ca14438a6744d3d1714e8c0/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:09.395507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e553fc-417e-4376-bf81-44aa4cff3f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d437841cc9b48539bfbb8f3ccabf0db, user_id=e90ca1492ca14438a6744d3d1714e8c0, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:09.398164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e553fc-417e-4376-bf81-44aa4cff3f89 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:09.409045 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1306/2622] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:09 2022] PUT /identity/v3/projects/7d437841cc9b48539bfbb8f3ccabf0db/users/e90ca1492ca14438a6744d3d1714e8c0/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:09.420491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd736350-f5dc-474d-9381-3ed250f954c0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:09.420816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd736350-f5dc-474d-9381-3ed250f954c0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:09.421124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd736350-f5dc-474d-9381-3ed250f954c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:09.448897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-bd736350-f5dc-474d-9381-3ed250f954c0 None None] MFA Rules not processed for user `e90ca1492ca14438a6744d3d1714e8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:09.450643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bd736350-f5dc-474d-9381-3ed250f954c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:09.483413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:09.521042 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1317/2623] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:09.533958 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e553fc-417e-4376-bf81-44aa4cff3f89 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:09.535689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6e553fc-417e-4376-bf81-44aa4cff3f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:09.614868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e553fc-417e-4376-bf81-44aa4cff3f89 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:09.618583 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950e7a9-9803-40b3-8560-ea12d62d8d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:09.619186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950e7a9-9803-40b3-8560-ea12d62d8d9c service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:09.619468 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950e7a9-9803-40b3-8560-ea12d62d8d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:09.619744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950e7a9-9803-40b3-8560-ea12d62d8d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:09.629090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950e7a9-9803-40b3-8560-ea12d62d8d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:09.630513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950e7a9-9803-40b3-8560-ea12d62d8d9c service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:09.640437 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1307/2624] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:09.714506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd736350-f5dc-474d-9381-3ed250f954c0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:09.724481 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd736350-f5dc-474d-9381-3ed250f954c0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:09.728007 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f8a0e-0c45-4a72-bbeb-ac6052d5db8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:09.728646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f8a0e-0c45-4a72-bbeb-ac6052d5db8d service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:09.728923 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f8a0e-0c45-4a72-bbeb-ac6052d5db8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:09.729198 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f8a0e-0c45-4a72-bbeb-ac6052d5db8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:09.786440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f8a0e-0c45-4a72-bbeb-ac6052d5db8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:09.787806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f8a0e-0c45-4a72-bbeb-ac6052d5db8d service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:09.797533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1318/2625] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:12.526186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950e7a9-9803-40b3-8560-ea12d62d8d9c service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:12.577250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:12.595934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950e7a9-9803-40b3-8560-ea12d62d8d9c service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:12.600513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:12.601135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:12.601420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:12.601694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] PATH_INFO: `/v3/users/c00d4a1ef18e4385be21bce16ea397bf` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:12.602804 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00d4a1ef18e4385be21bce16ea397bf)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:12.604767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:12.652619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00d4a1ef18e4385be21bce16ea397bf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:12.653354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00d4a1ef18e4385be21bce16ea397bf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:12.661484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00d4a1ef18e4385be21bce16ea397bf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:12.673683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00d4a1ef18e4385be21bce16ea397bf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:12.680431 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00d4a1ef18e4385be21bce16ea397bf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:12.686788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1308/2626] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:12 2022] DELETE /identity/v3/users/c00d4a1ef18e4385be21bce16ea397bf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:12.691217 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea69e-8a81-48ea-8020-6002d4b30a80 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:12.691715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea69e-8a81-48ea-8020-6002d4b30a80 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:12.691825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea69e-8a81-48ea-8020-6002d4b30a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:12.711156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fb0ea69e-8a81-48ea-8020-6002d4b30a80 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:12.712408 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fb0ea69e-8a81-48ea-8020-6002d4b30a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:12.772862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1319/2627] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:12.782680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:12.784236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:12.865403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171522e-02e8-4100-95ee-e684bdeb6f3a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:12.869484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d5041-75d5-4cc7-8f08-c52e481a166a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:12.870095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d5041-75d5-4cc7-8f08-c52e481a166a service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:12.870377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d5041-75d5-4cc7-8f08-c52e481a166a service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:12.870652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d5041-75d5-4cc7-8f08-c52e481a166a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:12.880503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d5041-75d5-4cc7-8f08-c52e481a166a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:12.881930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d5041-75d5-4cc7-8f08-c52e481a166a service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:12.892102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1309/2628] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:13.155918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ea69e-8a81-48ea-8020-6002d4b30a80 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:13.157846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fb0ea69e-8a81-48ea-8020-6002d4b30a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:13.171562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ea69e-8a81-48ea-8020-6002d4b30a80 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:13.176284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:13.176959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:13.177236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:13.177509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] PATH_INFO: `/v3/projects/8469af0be74549cbb73f018d6f223306` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:13.178694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8469af0be74549cbb73f018d6f223306)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:13.180583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:13.228061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8469af0be74549cbb73f018d6f223306', 'request_id': 'req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.234267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8469af0be74549cbb73f018d6f223306', 'request_id': 'req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.240345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8469af0be74549cbb73f018d6f223306', 'request_id': 'req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.242018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:13.254233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] The token cache is being invalidate because project 8469af0be74549cbb73f018d6f223306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:13.254525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.255140 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.256658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1320/2629] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:13 2022] DELETE /identity/v3/projects/8469af0be74549cbb73f018d6f223306 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:13.261217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d5041-75d5-4cc7-8f08-c52e481a166a service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:13.270836 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d5041-75d5-4cc7-8f08-c52e481a166a service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:13.311709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:13.327637 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:13.328263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:13.328573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:13.328847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] PATH_INFO: `/v3/users/e90ca1492ca14438a6744d3d1714e8c0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:13.329952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90ca1492ca14438a6744d3d1714e8c0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:13.331856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:13.377279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90ca1492ca14438a6744d3d1714e8c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.377925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90ca1492ca14438a6744d3d1714e8c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.385216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90ca1492ca14438a6744d3d1714e8c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.396879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90ca1492ca14438a6744d3d1714e8c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.404077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-66703a4d-228f-4181-aaa0-fb1da6cb43d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90ca1492ca14438a6744d3d1714e8c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.409827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1310/2630] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:13 2022] DELETE /identity/v3/users/e90ca1492ca14438a6744d3d1714e8c0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:18:13.682993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:13.685202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:13.698557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9ccda-b107-4f3c-899a-c2a5fbe0eb55 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:13.756139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:13.756790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:13.757071 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:13.757363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] PATH_INFO: `/v3/projects/7d437841cc9b48539bfbb8f3ccabf0db` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:13.758482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d437841cc9b48539bfbb8f3ccabf0db)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:13.760492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:13.806061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d437841cc9b48539bfbb8f3ccabf0db', 'request_id': 'req-0cdae259-ab4e-4478-b0a7-1d149868d53d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.812241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d437841cc9b48539bfbb8f3ccabf0db', 'request_id': 'req-0cdae259-ab4e-4478-b0a7-1d149868d53d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.818430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d437841cc9b48539bfbb8f3ccabf0db', 'request_id': 'req-0cdae259-ab4e-4478-b0a7-1d149868d53d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.831871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] The token cache is being invalidate because project 7d437841cc9b48539bfbb8f3ccabf0db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:13.832168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.832832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cdae259-ab4e-4478-b0a7-1d149868d53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:13.834304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1321/2631] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:13 2022] DELETE /identity/v3/projects/7d437841cc9b48539bfbb8f3ccabf0db => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:13.839171 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14483200-9181-4b9b-a15d-779e91f28a13 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:13.839691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14483200-9181-4b9b-a15d-779e91f28a13 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:13.839791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14483200-9181-4b9b-a15d-779e91f28a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:13.863907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-14483200-9181-4b9b-a15d-779e91f28a13 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:13.865253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-14483200-9181-4b9b-a15d-779e91f28a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:13.924518 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1311/2632] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:13.932238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b0ca1-ec42-4070-87dc-bc4cd5fab0f6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:13.932562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b0ca1-ec42-4070-87dc-bc4cd5fab0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:13.932846 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b0ca1-ec42-4070-87dc-bc4cd5fab0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:13.952943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b69b0ca1-ec42-4070-87dc-bc4cd5fab0f6 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:13.954128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b69b0ca1-ec42-4070-87dc-bc4cd5fab0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:13.962136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1322/2633] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:13.966890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14483200-9181-4b9b-a15d-779e91f28a13 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:13.976404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14483200-9181-4b9b-a15d-779e91f28a13 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:13.981228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697f9c-4584-499f-8394-a0487f0c43a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:13.981723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697f9c-4584-499f-8394-a0487f0c43a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:13.982001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697f9c-4584-499f-8394-a0487f0c43a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:13.982273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697f9c-4584-499f-8394-a0487f0c43a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:13.982910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d697f9c-4584-499f-8394-a0487f0c43a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:18:13.983211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d697f9c-4584-499f-8394-a0487f0c43a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:13.984825 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d697f9c-4584-499f-8394-a0487f0c43a6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:13.995975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1312/2634] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:18:14.000298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b0ca1-ec42-4070-87dc-bc4cd5fab0f6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.009537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b0ca1-ec42-4070-87dc-bc4cd5fab0f6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.015056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e36974-4d07-4958-ab2c-cdd8a72bb500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.015654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e36974-4d07-4958-ab2c-cdd8a72bb500 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.015937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e36974-4d07-4958-ab2c-cdd8a72bb500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.016213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e36974-4d07-4958-ab2c-cdd8a72bb500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.016939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e36974-4d07-4958-ab2c-cdd8a72bb500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.018861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e36974-4d07-4958-ab2c-cdd8a72bb500 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.046458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1323/2635] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:13 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:14.050554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697f9c-4584-499f-8394-a0487f0c43a6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.061264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697f9c-4584-499f-8394-a0487f0c43a6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.106845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:14.117949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93736e-f73a-450a-9761-c76a8de4987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.118573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93736e-f73a-450a-9761-c76a8de4987a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.118837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93736e-f73a-450a-9761-c76a8de4987a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.119116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93736e-f73a-450a-9761-c76a8de4987a admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.119774 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93736e-f73a-450a-9761-c76a8de4987a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.122418 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93736e-f73a-450a-9761-c76a8de4987a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.144295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1313/2636] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:14 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:14.148474 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e36974-4d07-4958-ab2c-cdd8a72bb500 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.159386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e36974-4d07-4958-ab2c-cdd8a72bb500 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.164381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7fcf1-1252-4705-b88f-6e5dc8a7df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.165029 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7fcf1-1252-4705-b88f-6e5dc8a7df28 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.165311 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7fcf1-1252-4705-b88f-6e5dc8a7df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.165591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7fcf1-1252-4705-b88f-6e5dc8a7df28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.166256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7fcf1-1252-4705-b88f-6e5dc8a7df28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.167949 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7fcf1-1252-4705-b88f-6e5dc8a7df28 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.178546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1324/2637] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:18:14.182420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93736e-f73a-450a-9761-c76a8de4987a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.192506 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93736e-f73a-450a-9761-c76a8de4987a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.197161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec103500-2194-4690-b42e-502a195c2a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.197755 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec103500-2194-4690-b42e-502a195c2a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.198041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec103500-2194-4690-b42e-502a195c2a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.198316 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec103500-2194-4690-b42e-502a195c2a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.198963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec103500-2194-4690-b42e-502a195c2a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.200614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec103500-2194-4690-b42e-502a195c2a79 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.211296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1314/2638] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:14.216014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7fcf1-1252-4705-b88f-6e5dc8a7df28 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.225965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7fcf1-1252-4705-b88f-6e5dc8a7df28 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.231465 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4866c-6620-4251-8253-d18ae3ee7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.232119 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4866c-6620-4251-8253-d18ae3ee7175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.232441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4866c-6620-4251-8253-d18ae3ee7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.232719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4866c-6620-4251-8253-d18ae3ee7175 admin admin] PATH_INFO: `/v3/projects/cd6553be662a42af8e4913dc5672d51f/users/3f858351988d4498acbcecc8e97a0d2b/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.248081 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4866c-6620-4251-8253-d18ae3ee7175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6553be662a42af8e4913dc5672d51f, user_id=3f858351988d4498acbcecc8e97a0d2b, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.250741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4866c-6620-4251-8253-d18ae3ee7175 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.263309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1325/2639] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:14 2022] PUT /identity/v3/projects/cd6553be662a42af8e4913dc5672d51f/users/3f858351988d4498acbcecc8e97a0d2b/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:14.273645 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabc528-5530-4ef2-9f14-76690f01c5ec None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.273937 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabc528-5530-4ef2-9f14-76690f01c5ec None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.274236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabc528-5530-4ef2-9f14-76690f01c5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.302216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1eabc528-5530-4ef2-9f14-76690f01c5ec None None] MFA Rules not processed for user `3f858351988d4498acbcecc8e97a0d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:14.303414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1eabc528-5530-4ef2-9f14-76690f01c5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:14.368660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1315/2640] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:14.373881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4866c-6620-4251-8253-d18ae3ee7175 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.393286 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:14.436475 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4866c-6620-4251-8253-d18ae3ee7175 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.441075 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9b16-8aa6-4fa0-92a7-5a00a5b895c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.441673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9b16-8aa6-4fa0-92a7-5a00a5b895c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.441951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9b16-8aa6-4fa0-92a7-5a00a5b895c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.442223 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9b16-8aa6-4fa0-92a7-5a00a5b895c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.442844 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc9b16-8aa6-4fa0-92a7-5a00a5b895c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.444756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc9b16-8aa6-4fa0-92a7-5a00a5b895c9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.471768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1326/2641] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:14 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:14.475854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabc528-5530-4ef2-9f14-76690f01c5ec None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.487224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabc528-5530-4ef2-9f14-76690f01c5ec None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.544608 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a7a12-3a8f-4a16-8c61-4f3b10510f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.545229 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a7a12-3a8f-4a16-8c61-4f3b10510f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.545512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a7a12-3a8f-4a16-8c61-4f3b10510f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.545813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a7a12-3a8f-4a16-8c61-4f3b10510f1b admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.546449 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a7a12-3a8f-4a16-8c61-4f3b10510f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.548398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a7a12-3a8f-4a16-8c61-4f3b10510f1b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.569972 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1316/2642] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:14 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:14.574012 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9b16-8aa6-4fa0-92a7-5a00a5b895c9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.584681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9b16-8aa6-4fa0-92a7-5a00a5b895c9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.589402 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7684-cd97-4e03-991d-8c9b83927c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.590068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7684-cd97-4e03-991d-8c9b83927c7a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.590458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7684-cd97-4e03-991d-8c9b83927c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.590746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7684-cd97-4e03-991d-8c9b83927c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.591471 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d7684-cd97-4e03-991d-8c9b83927c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.593079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d7684-cd97-4e03-991d-8c9b83927c7a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.603625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1327/2643] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:14.608300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a7a12-3a8f-4a16-8c61-4f3b10510f1b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.618138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a7a12-3a8f-4a16-8c61-4f3b10510f1b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.623572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52686060-ddd5-47e8-a8e5-08538dec7659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.624210 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52686060-ddd5-47e8-a8e5-08538dec7659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.624521 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52686060-ddd5-47e8-a8e5-08538dec7659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.624815 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52686060-ddd5-47e8-a8e5-08538dec7659 admin admin] PATH_INFO: `/v3/projects/e905e6a58c1647e389a6582526a8de85/users/f7321dd89930461284c3f30e20bb2c23/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.639326 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52686060-ddd5-47e8-a8e5-08538dec7659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e905e6a58c1647e389a6582526a8de85, user_id=f7321dd89930461284c3f30e20bb2c23, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.641982 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52686060-ddd5-47e8-a8e5-08538dec7659 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.654278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1317/2644] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:14 2022] PUT /identity/v3/projects/e905e6a58c1647e389a6582526a8de85/users/f7321dd89930461284c3f30e20bb2c23/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:14.658110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7684-cd97-4e03-991d-8c9b83927c7a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.668771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7684-cd97-4e03-991d-8c9b83927c7a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.727186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dbdaf-f38b-4e82-b463-515bad6a1785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.727871 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dbdaf-f38b-4e82-b463-515bad6a1785 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.728015 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dbdaf-f38b-4e82-b463-515bad6a1785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.728293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dbdaf-f38b-4e82-b463-515bad6a1785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.728974 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dbdaf-f38b-4e82-b463-515bad6a1785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.730617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dbdaf-f38b-4e82-b463-515bad6a1785 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.740901 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1328/2645] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:14.745055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52686060-ddd5-47e8-a8e5-08538dec7659 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.755372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52686060-ddd5-47e8-a8e5-08538dec7659 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.759989 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0ba2-8f0b-40a6-bd67-a8adafb048c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.760666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0ba2-8f0b-40a6-bd67-a8adafb048c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.760952 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0ba2-8f0b-40a6-bd67-a8adafb048c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.761227 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0ba2-8f0b-40a6-bd67-a8adafb048c8 admin admin] PATH_INFO: `/v3/projects/e905e6a58c1647e389a6582526a8de85/users/f7321dd89930461284c3f30e20bb2c23/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.763916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c0ba2-8f0b-40a6-bd67-a8adafb048c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e905e6a58c1647e389a6582526a8de85, user_id=f7321dd89930461284c3f30e20bb2c23, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:14.766616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c0ba2-8f0b-40a6-bd67-a8adafb048c8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:14.776633 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1318/2646] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:14 2022] PUT /identity/v3/projects/e905e6a58c1647e389a6582526a8de85/users/f7321dd89930461284c3f30e20bb2c23/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:14.788433 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f630b-b374-4928-b055-065c08b0ad68 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.788723 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f630b-b374-4928-b055-065c08b0ad68 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.789001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f630b-b374-4928-b055-065c08b0ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:14.816097 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c77f630b-b374-4928-b055-065c08b0ad68 None None] MFA Rules not processed for user `f7321dd89930461284c3f30e20bb2c23`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:14.817330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c77f630b-b374-4928-b055-065c08b0ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:14.884128 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1329/2647] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:14.896089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0ba2-8f0b-40a6-bd67-a8adafb048c8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:14.897930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4b8c0ba2-8f0b-40a6-bd67-a8adafb048c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:14.911532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:14.956053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0ba2-8f0b-40a6-bd67-a8adafb048c8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:14.959719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f34633-1984-44e5-981e-e437c5521a49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:14.960342 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f34633-1984-44e5-981e-e437c5521a49 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:14.960653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f34633-1984-44e5-981e-e437c5521a49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:14.960929 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f34633-1984-44e5-981e-e437c5521a49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:15.016365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f34633-1984-44e5-981e-e437c5521a49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:15.017718 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f34633-1984-44e5-981e-e437c5521a49 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:15.026327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1319/2648] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:16.385847 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f630b-b374-4928-b055-065c08b0ad68 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:16.387309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c77f630b-b374-4928-b055-065c08b0ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:16.399183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f630b-b374-4928-b055-065c08b0ad68 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:16.403492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72988e-75df-42fe-9072-4c5dabac020f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:16.404315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72988e-75df-42fe-9072-4c5dabac020f service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:16.404625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72988e-75df-42fe-9072-4c5dabac020f service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:16.404896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72988e-75df-42fe-9072-4c5dabac020f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:16.413803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72988e-75df-42fe-9072-4c5dabac020f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:16.415237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72988e-75df-42fe-9072-4c5dabac020f service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:16.421674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:16.428605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1330/2649] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:20.186162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f34633-1984-44e5-981e-e437c5521a49 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:20.250385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f34633-1984-44e5-981e-e437c5521a49 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:20.256092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:20.256821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:20.257101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:20.257372 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] PATH_INFO: `/v3/users/3f858351988d4498acbcecc8e97a0d2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:20.259464 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f858351988d4498acbcecc8e97a0d2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:20.262228 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:20.318968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f858351988d4498acbcecc8e97a0d2b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:20.319679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f858351988d4498acbcecc8e97a0d2b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:20.327371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f858351988d4498acbcecc8e97a0d2b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:20.338012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:20.340879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f858351988d4498acbcecc8e97a0d2b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:20.349917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f858351988d4498acbcecc8e97a0d2b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:20.356408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1320/2650] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:20 2022] DELETE /identity/v3/users/3f858351988d4498acbcecc8e97a0d2b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:20.360625 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca2107-7173-476f-83bd-73808307cb0a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:20.361461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca2107-7173-476f-83bd-73808307cb0a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:20.361737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca2107-7173-476f-83bd-73808307cb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:20.382991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8aca2107-7173-476f-83bd-73808307cb0a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:20.384222 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8aca2107-7173-476f-83bd-73808307cb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:20.447153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1331/2651] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:20.455425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:20.456921 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:20.515828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211555d6-c534-4f50-9e73-6dc0f70f9acd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:20.519826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a493187-906e-41c5-95ea-c4fd13e0d855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:20.520881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a493187-906e-41c5-95ea-c4fd13e0d855 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:20.520881 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a493187-906e-41c5-95ea-c4fd13e0d855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:20.521258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a493187-906e-41c5-95ea-c4fd13e0d855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:20.531567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a493187-906e-41c5-95ea-c4fd13e0d855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:20.533348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a493187-906e-41c5-95ea-c4fd13e0d855 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:20.544625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1321/2652] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:20.861501 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca2107-7173-476f-83bd-73808307cb0a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:20.863313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8aca2107-7173-476f-83bd-73808307cb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:20.879204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca2107-7173-476f-83bd-73808307cb0a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:20.886290 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:20.887583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:20.887964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:20.888312 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] PATH_INFO: `/v3/projects/cd6553be662a42af8e4913dc5672d51f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:20.889589 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6553be662a42af8e4913dc5672d51f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:20.891972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:20.940982 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6553be662a42af8e4913dc5672d51f', 'request_id': 'req-25a0e738-19ae-4f95-bf0b-77d957f31eed'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:20.947054 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6553be662a42af8e4913dc5672d51f', 'request_id': 'req-25a0e738-19ae-4f95-bf0b-77d957f31eed'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:20.955060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6553be662a42af8e4913dc5672d51f', 'request_id': 'req-25a0e738-19ae-4f95-bf0b-77d957f31eed'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:20.968578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] The token cache is being invalidate because project cd6553be662a42af8e4913dc5672d51f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:20.968876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:20.969519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:20.971201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1332/2653] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:20 2022] DELETE /identity/v3/projects/cd6553be662a42af8e4913dc5672d51f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:20.975073 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a493187-906e-41c5-95ea-c4fd13e0d855 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:20.985536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a493187-906e-41c5-95ea-c4fd13e0d855 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:21.045885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:21.046529 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:21.046811 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:21.047091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] PATH_INFO: `/v3/users/f7321dd89930461284c3f30e20bb2c23` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:21.048235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7321dd89930461284c3f30e20bb2c23)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:21.050211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:21.115024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7321dd89930461284c3f30e20bb2c23'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:21.115690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7321dd89930461284c3f30e20bb2c23'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:21.131697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7321dd89930461284c3f30e20bb2c23'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:21.147954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7321dd89930461284c3f30e20bb2c23'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:21.154277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7851a86d-6450-4dfd-8ccb-297674c4be49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7321dd89930461284c3f30e20bb2c23'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:21.161442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1322/2654] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:20 2022] DELETE /identity/v3/users/f7321dd89930461284c3f30e20bb2c23 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:21.471219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:21.473587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:21.489718 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0e738-19ae-4f95-bf0b-77d957f31eed admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:21.555904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:21.556374 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:21.556719 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:21.556943 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] PATH_INFO: `/v3/projects/e905e6a58c1647e389a6582526a8de85` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:21.558191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e905e6a58c1647e389a6582526a8de85)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:21.561147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:21.593708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:21.612214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e905e6a58c1647e389a6582526a8de85', 'request_id': 'req-948d0266-5d93-4f28-8e77-cecfc59c31a7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:21.617821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e905e6a58c1647e389a6582526a8de85', 'request_id': 'req-948d0266-5d93-4f28-8e77-cecfc59c31a7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:21.625885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e905e6a58c1647e389a6582526a8de85', 'request_id': 'req-948d0266-5d93-4f28-8e77-cecfc59c31a7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:21.638946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] The token cache is being invalidate because project e905e6a58c1647e389a6582526a8de85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:21.639243 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:21.639875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-948d0266-5d93-4f28-8e77-cecfc59c31a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:21.641403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1333/2655] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:21 2022] DELETE /identity/v3/projects/e905e6a58c1647e389a6582526a8de85 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:21.646526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9457-77fd-46ef-9f28-bcbe908ec7f8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:21.647064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9457-77fd-46ef-9f28-bcbe908ec7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:21.647064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9457-77fd-46ef-9f28-bcbe908ec7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:21.661311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:21.669697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6e6f9457-77fd-46ef-9f28-bcbe908ec7f8 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:21.671743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6e6f9457-77fd-46ef-9f28-bcbe908ec7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:21.742091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1323/2656] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:21.743692 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c70eb-055d-4c80-b708-f044fa35cb66 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:21.743999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c70eb-055d-4c80-b708-f044fa35cb66 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:21.744263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c70eb-055d-4c80-b708-f044fa35cb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:21.764096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0f5c70eb-055d-4c80-b708-f044fa35cb66 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:21.765354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0f5c70eb-055d-4c80-b708-f044fa35cb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:21.773257 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1334/2657] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:18:21.778014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9457-77fd-46ef-9f28-bcbe908ec7f8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:21.787571 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9457-77fd-46ef-9f28-bcbe908ec7f8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:21.792116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac900c0-d696-4c3c-a33d-d73c194e6f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:21.792747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac900c0-d696-4c3c-a33d-d73c194e6f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:21.793719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac900c0-d696-4c3c-a33d-d73c194e6f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:21.794179 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac900c0-d696-4c3c-a33d-d73c194e6f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:21.794909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac900c0-d696-4c3c-a33d-d73c194e6f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:18:21.795220 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac900c0-d696-4c3c-a33d-d73c194e6f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:21.796854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac900c0-d696-4c3c-a33d-d73c194e6f45 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:21.810435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1324/2658] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:18:21.814820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c70eb-055d-4c80-b708-f044fa35cb66 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:21.825428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c70eb-055d-4c80-b708-f044fa35cb66 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:21.830470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99436288-9632-4e66-a1ec-4537457aacdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:21.831098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99436288-9632-4e66-a1ec-4537457aacdc admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:21.831381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99436288-9632-4e66-a1ec-4537457aacdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:21.831654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99436288-9632-4e66-a1ec-4537457aacdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:21.832295 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99436288-9632-4e66-a1ec-4537457aacdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:21.834216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99436288-9632-4e66-a1ec-4537457aacdc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:21.870914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1335/2659] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:21 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:21.875586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac900c0-d696-4c3c-a33d-d73c194e6f45 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:21.885445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac900c0-d696-4c3c-a33d-d73c194e6f45 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:21.942873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc455ad-2564-4801-af19-21a59c2df5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:21.943474 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc455ad-2564-4801-af19-21a59c2df5bf admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:21.943757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc455ad-2564-4801-af19-21a59c2df5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:21.944034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc455ad-2564-4801-af19-21a59c2df5bf admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:21.944702 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc455ad-2564-4801-af19-21a59c2df5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:21.946607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc455ad-2564-4801-af19-21a59c2df5bf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:21.967783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1325/2660] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:21 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:21.971935 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99436288-9632-4e66-a1ec-4537457aacdc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:21.982703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99436288-9632-4e66-a1ec-4537457aacdc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:21.987484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d8310-68a7-4c21-a4a9-bd6c8ffb8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:21.988084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d8310-68a7-4c21-a4a9-bd6c8ffb8ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:21.988395 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d8310-68a7-4c21-a4a9-bd6c8ffb8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:21.988673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d8310-68a7-4c21-a4a9-bd6c8ffb8ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:21.989313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d8310-68a7-4c21-a4a9-bd6c8ffb8ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:21.990895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d8310-68a7-4c21-a4a9-bd6c8ffb8ee3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.001505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1336/2661] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:22.005294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc455ad-2564-4801-af19-21a59c2df5bf admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.016140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc455ad-2564-4801-af19-21a59c2df5bf admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.020932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f026d6-d405-4c5c-82fa-90eeb9f21e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.021523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f026d6-d405-4c5c-82fa-90eeb9f21e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.021799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f026d6-d405-4c5c-82fa-90eeb9f21e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.022067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f026d6-d405-4c5c-82fa-90eeb9f21e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.022699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f026d6-d405-4c5c-82fa-90eeb9f21e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.024260 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f026d6-d405-4c5c-82fa-90eeb9f21e4f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.034746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1326/2662] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:22.039056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d8310-68a7-4c21-a4a9-bd6c8ffb8ee3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.049906 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d8310-68a7-4c21-a4a9-bd6c8ffb8ee3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.054636 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9b043-2e3c-4fdb-827c-cde25196a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.055293 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b043-2e3c-4fdb-827c-cde25196a075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.055576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b043-2e3c-4fdb-827c-cde25196a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.055853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b043-2e3c-4fdb-827c-cde25196a075 admin admin] PATH_INFO: `/v3/projects/7ab4b02c8a3349ecae80aa2b486a5285/users/aba3d3905e2f4a8fa98a130f7bb933f8/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.071176 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9b043-2e3c-4fdb-827c-cde25196a075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab4b02c8a3349ecae80aa2b486a5285, user_id=aba3d3905e2f4a8fa98a130f7bb933f8, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.073829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9b043-2e3c-4fdb-827c-cde25196a075 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.086987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1337/2663] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:22 2022] PUT /identity/v3/projects/7ab4b02c8a3349ecae80aa2b486a5285/users/aba3d3905e2f4a8fa98a130f7bb933f8/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:22.098430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3652-7132-4906-8e18-85b86c394204 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.098721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3652-7132-4906-8e18-85b86c394204 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.098996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3652-7132-4906-8e18-85b86c394204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.127258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e09a3652-7132-4906-8e18-85b86c394204 None None] MFA Rules not processed for user `aba3d3905e2f4a8fa98a130f7bb933f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:22.128536 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e09a3652-7132-4906-8e18-85b86c394204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:22.194080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1327/2664] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:22.198586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9b043-2e3c-4fdb-827c-cde25196a075 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.259581 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9b043-2e3c-4fdb-827c-cde25196a075 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.265056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ee525-be49-49c3-8abe-7b51d9c326a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.265681 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ee525-be49-49c3-8abe-7b51d9c326a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.265963 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ee525-be49-49c3-8abe-7b51d9c326a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.266234 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ee525-be49-49c3-8abe-7b51d9c326a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.266898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ee525-be49-49c3-8abe-7b51d9c326a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.268820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ee525-be49-49c3-8abe-7b51d9c326a4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.295543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1338/2665] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:22 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:22.299898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a3652-7132-4906-8e18-85b86c394204 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.305854 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:22.312816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a3652-7132-4906-8e18-85b86c394204 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.376262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ae4a8-dc51-4387-9332-2296af1bb08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.376925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ae4a8-dc51-4387-9332-2296af1bb08c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.377207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ae4a8-dc51-4387-9332-2296af1bb08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.377480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ae4a8-dc51-4387-9332-2296af1bb08c admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.378114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ae4a8-dc51-4387-9332-2296af1bb08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.380024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ae4a8-dc51-4387-9332-2296af1bb08c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.406713 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1328/2666] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:22 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:18:22.408601 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ee525-be49-49c3-8abe-7b51d9c326a4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.419756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ee525-be49-49c3-8abe-7b51d9c326a4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.424502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649af3d5-12b9-4778-85c5-88a9f9cc6c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.425111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af3d5-12b9-4778-85c5-88a9f9cc6c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.425396 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af3d5-12b9-4778-85c5-88a9f9cc6c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.425669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af3d5-12b9-4778-85c5-88a9f9cc6c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.426314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649af3d5-12b9-4778-85c5-88a9f9cc6c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.427940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649af3d5-12b9-4778-85c5-88a9f9cc6c81 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.439224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1339/2667] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:22.443315 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ae4a8-dc51-4387-9332-2296af1bb08c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.453844 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ae4a8-dc51-4387-9332-2296af1bb08c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.458471 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87213cee-63d0-43c2-8181-8d942be5a22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.459097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87213cee-63d0-43c2-8181-8d942be5a22b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.459376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87213cee-63d0-43c2-8181-8d942be5a22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.459651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87213cee-63d0-43c2-8181-8d942be5a22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.460314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87213cee-63d0-43c2-8181-8d942be5a22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.461912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87213cee-63d0-43c2-8181-8d942be5a22b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.472370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1329/2668] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:22.476591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649af3d5-12b9-4778-85c5-88a9f9cc6c81 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.488277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649af3d5-12b9-4778-85c5-88a9f9cc6c81 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.493587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae646764-fe41-4834-bec3-af39dc265090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.494236 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646764-fe41-4834-bec3-af39dc265090 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.494516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646764-fe41-4834-bec3-af39dc265090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.494789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646764-fe41-4834-bec3-af39dc265090 admin admin] PATH_INFO: `/v3/projects/da3a1109ac0a467c9e57547ed604b8e8/users/3d841c99d73a43cb985884343114f0e8/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.507033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:22.510490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae646764-fe41-4834-bec3-af39dc265090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3a1109ac0a467c9e57547ed604b8e8, user_id=3d841c99d73a43cb985884343114f0e8, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.513727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae646764-fe41-4834-bec3-af39dc265090 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.529443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1340/2669] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:22 2022] PUT /identity/v3/projects/da3a1109ac0a467c9e57547ed604b8e8/users/3d841c99d73a43cb985884343114f0e8/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:22.598982 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d420-f762-4740-8940-4ba649339f51 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.599188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d420-f762-4740-8940-4ba649339f51 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.599445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d420-f762-4740-8940-4ba649339f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.628614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7792d420-f762-4740-8940-4ba649339f51 None None] MFA Rules not processed for user `3d841c99d73a43cb985884343114f0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:22.629862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7792d420-f762-4740-8940-4ba649339f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:22.695035 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1330/2670] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:22.700480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae646764-fe41-4834-bec3-af39dc265090 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.767775 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae646764-fe41-4834-bec3-af39dc265090 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.772727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c457c7-c9a4-41b8-adca-f34edf1e2b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.773342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c457c7-c9a4-41b8-adca-f34edf1e2b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.773623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c457c7-c9a4-41b8-adca-f34edf1e2b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.773900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c457c7-c9a4-41b8-adca-f34edf1e2b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.774547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c457c7-c9a4-41b8-adca-f34edf1e2b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.776487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c457c7-c9a4-41b8-adca-f34edf1e2b96 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.804207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1341/2671] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:22 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:22.808196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d420-f762-4740-8940-4ba649339f51 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.819743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d420-f762-4740-8940-4ba649339f51 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.880514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc85d3-b18d-4ec4-b2d5-e203a9206145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.881137 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc85d3-b18d-4ec4-b2d5-e203a9206145 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.881492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc85d3-b18d-4ec4-b2d5-e203a9206145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.881775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc85d3-b18d-4ec4-b2d5-e203a9206145 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.882508 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc85d3-b18d-4ec4-b2d5-e203a9206145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.884524 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc85d3-b18d-4ec4-b2d5-e203a9206145 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.901864 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:22.916820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1331/2672] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:22 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:22.918518 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c457c7-c9a4-41b8-adca-f34edf1e2b96 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.930058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c457c7-c9a4-41b8-adca-f34edf1e2b96 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.935613 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5457f-900e-410a-87bb-8361e2f59a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.938178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5457f-900e-410a-87bb-8361e2f59a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.938496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5457f-900e-410a-87bb-8361e2f59a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.939456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5457f-900e-410a-87bb-8361e2f59a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.940276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5457f-900e-410a-87bb-8361e2f59a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.942025 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5457f-900e-410a-87bb-8361e2f59a05 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:22.958993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1342/2673] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:22.960221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc85d3-b18d-4ec4-b2d5-e203a9206145 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:22.971790 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc85d3-b18d-4ec4-b2d5-e203a9206145 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:22.976620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63748a00-c7d2-425b-8627-774862deb2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:22.977466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748a00-c7d2-425b-8627-774862deb2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:22.977820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748a00-c7d2-425b-8627-774862deb2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:22.978192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748a00-c7d2-425b-8627-774862deb2dc admin admin] PATH_INFO: `/v3/projects/126740d017134c17979c7f789a2593bb/users/da4f8323e0ac4ff18a4456274ca6284c/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:22.993745 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63748a00-c7d2-425b-8627-774862deb2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=126740d017134c17979c7f789a2593bb, user_id=da4f8323e0ac4ff18a4456274ca6284c, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:22.996556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63748a00-c7d2-425b-8627-774862deb2dc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:23.012856 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1332/2674] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:22 2022] PUT /identity/v3/projects/126740d017134c17979c7f789a2593bb/users/da4f8323e0ac4ff18a4456274ca6284c/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:23.017659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5457f-900e-410a-87bb-8361e2f59a05 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:23.029279 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5457f-900e-410a-87bb-8361e2f59a05 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:23.088270 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9100f-08e7-4608-ab07-1b8c62420065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:23.088904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9100f-08e7-4608-ab07-1b8c62420065 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:23.089184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9100f-08e7-4608-ab07-1b8c62420065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:23.089456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9100f-08e7-4608-ab07-1b8c62420065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:23.090788 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9100f-08e7-4608-ab07-1b8c62420065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:23.092417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9100f-08e7-4608-ab07-1b8c62420065 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:23.103870 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1343/2675] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:23.108057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63748a00-c7d2-425b-8627-774862deb2dc admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:23.118116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63748a00-c7d2-425b-8627-774862deb2dc admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:23.123537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133517d4-cb81-469a-a61c-1e61395082e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:23.124286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133517d4-cb81-469a-a61c-1e61395082e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:23.124672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133517d4-cb81-469a-a61c-1e61395082e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:23.125017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133517d4-cb81-469a-a61c-1e61395082e0 admin admin] PATH_INFO: `/v3/projects/126740d017134c17979c7f789a2593bb/users/da4f8323e0ac4ff18a4456274ca6284c/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:23.127251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133517d4-cb81-469a-a61c-1e61395082e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126740d017134c17979c7f789a2593bb, user_id=da4f8323e0ac4ff18a4456274ca6284c, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:23.130117 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133517d4-cb81-469a-a61c-1e61395082e0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:23.142083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1333/2676] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:23 2022] PUT /identity/v3/projects/126740d017134c17979c7f789a2593bb/users/da4f8323e0ac4ff18a4456274ca6284c/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:23.152433 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ed97d-b55a-4930-a6e3-bf9d36973914 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:23.152728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ed97d-b55a-4930-a6e3-bf9d36973914 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:23.153017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ed97d-b55a-4930-a6e3-bf9d36973914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:23.182101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6d8ed97d-b55a-4930-a6e3-bf9d36973914 None None] MFA Rules not processed for user `da4f8323e0ac4ff18a4456274ca6284c`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:23.183353 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6d8ed97d-b55a-4930-a6e3-bf9d36973914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:23.234972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:23.265804 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1344/2677] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:23.277335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133517d4-cb81-469a-a61c-1e61395082e0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:23.279060 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-133517d4-cb81-469a-a61c-1e61395082e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:23.347493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133517d4-cb81-469a-a61c-1e61395082e0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:23.351375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910bd6f-de42-4d93-a281-6139be4dfddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:23.352198 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910bd6f-de42-4d93-a281-6139be4dfddf service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:23.352707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910bd6f-de42-4d93-a281-6139be4dfddf service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:23.353154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910bd6f-de42-4d93-a281-6139be4dfddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:23.370544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910bd6f-de42-4d93-a281-6139be4dfddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:23.372687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910bd6f-de42-4d93-a281-6139be4dfddf service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:23.383721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1334/2678] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:23.923004 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ed97d-b55a-4930-a6e3-bf9d36973914 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:23.925975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6d8ed97d-b55a-4930-a6e3-bf9d36973914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:23.938577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ed97d-b55a-4930-a6e3-bf9d36973914 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:23.942512 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58708939-6185-4d30-89ce-ca6fd4774421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:23.943129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708939-6185-4d30-89ce-ca6fd4774421 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:23.943417 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708939-6185-4d30-89ce-ca6fd4774421 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:23.943698 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708939-6185-4d30-89ce-ca6fd4774421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:24.005167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58708939-6185-4d30-89ce-ca6fd4774421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:24.006703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58708939-6185-4d30-89ce-ca6fd4774421 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:24.016890 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1345/2679] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:24.324898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e1ef3-6adb-44f6-a957-86026d198c39 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:24.325408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e1ef3-6adb-44f6-a957-86026d198c39 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:24.325598 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e1ef3-6adb-44f6-a957-86026d198c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:24.348067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-467e1ef3-6adb-44f6-a957-86026d198c39 None None] MFA Rules not processed for user `a7607c50966b458696e4ab9c741deef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:24.348067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-467e1ef3-6adb-44f6-a957-86026d198c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:24.404103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1335/2680] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:18:26.142529 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58708939-6185-4d30-89ce-ca6fd4774421 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:26.144083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-58708939-6185-4d30-89ce-ca6fd4774421 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:26.207980 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58708939-6185-4d30-89ce-ca6fd4774421 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:26.211543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64318e-b82b-4d0e-bd8b-25878115042c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:26.212148 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64318e-b82b-4d0e-bd8b-25878115042c service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:26.212473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64318e-b82b-4d0e-bd8b-25878115042c service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:26.212750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64318e-b82b-4d0e-bd8b-25878115042c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:26.214470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bb64318e-b82b-4d0e-bd8b-25878115042c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:26.307778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64318e-b82b-4d0e-bd8b-25878115042c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:26.309820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64318e-b82b-4d0e-bd8b-25878115042c service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:26.328360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:26.332952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1346/2681] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:27.468755 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e1ef3-6adb-44f6-a957-86026d198c39 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:27.478782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e1ef3-6adb-44f6-a957-86026d198c39 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:27.484509 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dbf7a-e3bc-4e43-8e2d-8cb45a2057e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:27.485130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dbf7a-e3bc-4e43-8e2d-8cb45a2057e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:27.485412 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dbf7a-e3bc-4e43-8e2d-8cb45a2057e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:27.485690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dbf7a-e3bc-4e43-8e2d-8cb45a2057e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:27.487458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0d9dbf7a-e3bc-4e43-8e2d-8cb45a2057e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:27.503041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dbf7a-e3bc-4e43-8e2d-8cb45a2057e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:27.504583 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dbf7a-e3bc-4e43-8e2d-8cb45a2057e6 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:27.516802 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1336/2682] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:28.123040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64318e-b82b-4d0e-bd8b-25878115042c service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:28.132715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64318e-b82b-4d0e-bd8b-25878115042c service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:28.136427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381689e-0a69-4a09-bc1e-e5f58c468d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:28.137908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381689e-0a69-4a09-bc1e-e5f58c468d29 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:28.138190 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381689e-0a69-4a09-bc1e-e5f58c468d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:28.138461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381689e-0a69-4a09-bc1e-e5f58c468d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:28.200182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381689e-0a69-4a09-bc1e-e5f58c468d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:28.201829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381689e-0a69-4a09-bc1e-e5f58c468d29 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:28.217737 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1347/2683] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:30.300390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dbf7a-e3bc-4e43-8e2d-8cb45a2057e6 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:30.358640 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:30.363187 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dbf7a-e3bc-4e43-8e2d-8cb45a2057e6 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:30.368779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:30.369411 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:30.369694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:30.369968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] PATH_INFO: `/v3/users/aba3d3905e2f4a8fa98a130f7bb933f8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:30.371258 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba3d3905e2f4a8fa98a130f7bb933f8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:30.373123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:30.418561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba3d3905e2f4a8fa98a130f7bb933f8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:30.419119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba3d3905e2f4a8fa98a130f7bb933f8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:30.426327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba3d3905e2f4a8fa98a130f7bb933f8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:30.438027 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba3d3905e2f4a8fa98a130f7bb933f8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:30.444740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba3d3905e2f4a8fa98a130f7bb933f8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:30.451200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1337/2684] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:30 2022] DELETE /identity/v3/users/aba3d3905e2f4a8fa98a130f7bb933f8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:30.455977 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd211f9-cffb-43f0-9395-42059c217ee4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:30.456487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd211f9-cffb-43f0-9395-42059c217ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:30.456585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd211f9-cffb-43f0-9395-42059c217ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:30.476121 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-cdd211f9-cffb-43f0-9395-42059c217ee4 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:30.477420 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cdd211f9-cffb-43f0-9395-42059c217ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:30.540944 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1348/2685] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:30.553938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:30.555700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:30.617567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accac92-30db-4a60-9be3-91df8e07d5a2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:30.621843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bf998-57b1-4a24-bb80-1b2f8bf010e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:30.622466 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bf998-57b1-4a24-bb80-1b2f8bf010e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:30.622742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bf998-57b1-4a24-bb80-1b2f8bf010e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:30.623016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bf998-57b1-4a24-bb80-1b2f8bf010e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:30.631830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bf998-57b1-4a24-bb80-1b2f8bf010e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:30.633425 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bf998-57b1-4a24-bb80-1b2f8bf010e3 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:30.643398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1338/2686] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:30.921443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd211f9-cffb-43f0-9395-42059c217ee4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:30.922908 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cdd211f9-cffb-43f0-9395-42059c217ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:30.936055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd211f9-cffb-43f0-9395-42059c217ee4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:30.941191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:30.941826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:30.942104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:30.942375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] PATH_INFO: `/v3/projects/7ab4b02c8a3349ecae80aa2b486a5285` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:30.943510 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab4b02c8a3349ecae80aa2b486a5285)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:30.945445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:30.993019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab4b02c8a3349ecae80aa2b486a5285', 'request_id': 'req-3ccb8641-b083-42e9-94b1-52058d11ab7b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:30.999073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab4b02c8a3349ecae80aa2b486a5285', 'request_id': 'req-3ccb8641-b083-42e9-94b1-52058d11ab7b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.005193 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab4b02c8a3349ecae80aa2b486a5285', 'request_id': 'req-3ccb8641-b083-42e9-94b1-52058d11ab7b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.017694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] The token cache is being invalidate because project 7ab4b02c8a3349ecae80aa2b486a5285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:31.017987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.018617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.020109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1349/2687] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:30 2022] DELETE /identity/v3/projects/7ab4b02c8a3349ecae80aa2b486a5285 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:31.024261 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bf998-57b1-4a24-bb80-1b2f8bf010e3 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:31.033897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bf998-57b1-4a24-bb80-1b2f8bf010e3 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:31.092705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:31.093434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:31.093720 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:31.094027 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] PATH_INFO: `/v3/users/3d841c99d73a43cb985884343114f0e8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:31.095186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d841c99d73a43cb985884343114f0e8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:31.097170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:31.119310 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:31.162166 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d841c99d73a43cb985884343114f0e8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.162935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d841c99d73a43cb985884343114f0e8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.171491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d841c99d73a43cb985884343114f0e8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.187146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d841c99d73a43cb985884343114f0e8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.198829 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d841c99d73a43cb985884343114f0e8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.207056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1339/2688] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:31 2022] DELETE /identity/v3/users/3d841c99d73a43cb985884343114f0e8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:31.487778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:31.489535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:31.510251 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb8641-b083-42e9-94b1-52058d11ab7b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:31.530763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:31.573768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:31.575060 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:31.575340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:31.575612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] PATH_INFO: `/v3/projects/da3a1109ac0a467c9e57547ed604b8e8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:31.577034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3a1109ac0a467c9e57547ed604b8e8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:31.578932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:31.630628 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3a1109ac0a467c9e57547ed604b8e8', 'request_id': 'req-24acdccf-3bbd-4631-9853-9bc1a6c624e3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.636961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3a1109ac0a467c9e57547ed604b8e8', 'request_id': 'req-24acdccf-3bbd-4631-9853-9bc1a6c624e3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.643487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3a1109ac0a467c9e57547ed604b8e8', 'request_id': 'req-24acdccf-3bbd-4631-9853-9bc1a6c624e3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.657924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] The token cache is being invalidate because project da3a1109ac0a467c9e57547ed604b8e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:31.658225 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.658873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.660428 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1350/2689] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:31 2022] DELETE /identity/v3/projects/da3a1109ac0a467c9e57547ed604b8e8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:18:31.664569 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:31.667017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:31.681933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da083e1-ada2-4857-95d7-8d0f0bf36341 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:31.748470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:31.748956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:31.749246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:31.749535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] PATH_INFO: `/v3/users/da4f8323e0ac4ff18a4456274ca6284c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:31.750695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4f8323e0ac4ff18a4456274ca6284c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:31.752695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:31.799283 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4f8323e0ac4ff18a4456274ca6284c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.799947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4f8323e0ac4ff18a4456274ca6284c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.807176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4f8323e0ac4ff18a4456274ca6284c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.819370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4f8323e0ac4ff18a4456274ca6284c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.826948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b992f87-c279-4fbe-99f4-d0efc6126dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4f8323e0ac4ff18a4456274ca6284c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:31.833121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1340/2690] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:31 2022] DELETE /identity/v3/users/da4f8323e0ac4ff18a4456274ca6284c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:32.116551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:32.118093 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:32.134973 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acdccf-3bbd-4631-9853-9bc1a6c624e3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:32.195780 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:32.196469 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.196759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.197065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] PATH_INFO: `/v3/projects/126740d017134c17979c7f789a2593bb` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.198191 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=126740d017134c17979c7f789a2593bb)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:32.200111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:32.245499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126740d017134c17979c7f789a2593bb', 'request_id': 'req-c230f088-f43b-4561-9888-9cd002d16dce'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:32.249500 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:32.251712 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126740d017134c17979c7f789a2593bb', 'request_id': 'req-c230f088-f43b-4561-9888-9cd002d16dce'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:32.259142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126740d017134c17979c7f789a2593bb', 'request_id': 'req-c230f088-f43b-4561-9888-9cd002d16dce'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:32.271491 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] The token cache is being invalidate because project 126740d017134c17979c7f789a2593bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:32.271784 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:32.272442 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c230f088-f43b-4561-9888-9cd002d16dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:32.273936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1351/2691] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:32 2022] DELETE /identity/v3/projects/126740d017134c17979c7f789a2593bb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:32.280948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9b6c-81f1-4990-9374-9f3b80c28b58 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.281248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9b6c-81f1-4990-9374-9f3b80c28b58 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.281522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9b6c-81f1-4990-9374-9f3b80c28b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.302207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-05cd9b6c-81f1-4990-9374-9f3b80c28b58 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:32.303428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-05cd9b6c-81f1-4990-9374-9f3b80c28b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:32.315779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:32.368539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1341/2692] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:32.377043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ad289-a3a7-4a43-bc25-6e111418ff88 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.377837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ad289-a3a7-4a43-bc25-6e111418ff88 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.378126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ad289-a3a7-4a43-bc25-6e111418ff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.398083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-190ad289-a3a7-4a43-bc25-6e111418ff88 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:32.399283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-190ad289-a3a7-4a43-bc25-6e111418ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:32.408255 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1352/2693] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:18:32.412251 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9b6c-81f1-4990-9374-9f3b80c28b58 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:32.422551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9b6c-81f1-4990-9374-9f3b80c28b58 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:32.427166 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14615653-b66a-452f-b252-5ab69c9a13d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:32.427767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14615653-b66a-452f-b252-5ab69c9a13d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.428053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14615653-b66a-452f-b252-5ab69c9a13d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.428341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14615653-b66a-452f-b252-5ab69c9a13d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.429005 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14615653-b66a-452f-b252-5ab69c9a13d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:18:32.429312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14615653-b66a-452f-b252-5ab69c9a13d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:32.430915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14615653-b66a-452f-b252-5ab69c9a13d3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:32.442199 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1342/2694] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:18:32.446397 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ad289-a3a7-4a43-bc25-6e111418ff88 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:32.456002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ad289-a3a7-4a43-bc25-6e111418ff88 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:32.460730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280453-ca9c-48cc-b220-574ba3d28047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:32.461335 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280453-ca9c-48cc-b220-574ba3d28047 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.461620 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280453-ca9c-48cc-b220-574ba3d28047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.461898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280453-ca9c-48cc-b220-574ba3d28047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.462543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21280453-ca9c-48cc-b220-574ba3d28047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:32.464484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21280453-ca9c-48cc-b220-574ba3d28047 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:32.493045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1353/2695] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:32 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:32.497390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14615653-b66a-452f-b252-5ab69c9a13d3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:32.507238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14615653-b66a-452f-b252-5ab69c9a13d3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:32.563795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f83736-c24b-41a2-9580-46845d6d7abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:32.564427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83736-c24b-41a2-9580-46845d6d7abd admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.564711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83736-c24b-41a2-9580-46845d6d7abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.564984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83736-c24b-41a2-9580-46845d6d7abd admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.565853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f83736-c24b-41a2-9580-46845d6d7abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:32.567757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f83736-c24b-41a2-9580-46845d6d7abd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:32.589475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1343/2696] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:32 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:32.594241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280453-ca9c-48cc-b220-574ba3d28047 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:32.604580 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280453-ca9c-48cc-b220-574ba3d28047 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:32.609196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ea7b1-0aa6-4cf4-8efd-2250b045c6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:32.609792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ea7b1-0aa6-4cf4-8efd-2250b045c6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.610073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ea7b1-0aa6-4cf4-8efd-2250b045c6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.610348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ea7b1-0aa6-4cf4-8efd-2250b045c6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.610992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ea7b1-0aa6-4cf4-8efd-2250b045c6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:32.612610 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ea7b1-0aa6-4cf4-8efd-2250b045c6ba admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:32.622537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1354/2697] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:32.626185 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f83736-c24b-41a2-9580-46845d6d7abd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:32.636272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f83736-c24b-41a2-9580-46845d6d7abd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:32.641997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd72537-5a4f-439d-a4c8-24a1cea65724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:32.642592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd72537-5a4f-439d-a4c8-24a1cea65724 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.642872 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd72537-5a4f-439d-a4c8-24a1cea65724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.643145 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd72537-5a4f-439d-a4c8-24a1cea65724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.643782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd72537-5a4f-439d-a4c8-24a1cea65724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:32.645389 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd72537-5a4f-439d-a4c8-24a1cea65724 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:32.657572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1344/2698] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:32.661776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ea7b1-0aa6-4cf4-8efd-2250b045c6ba admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:32.671790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ea7b1-0aa6-4cf4-8efd-2250b045c6ba admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:32.676413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf99a-ff03-4a47-bd46-5b7769f7bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:32.677061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf99a-ff03-4a47-bd46-5b7769f7bc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.677341 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf99a-ff03-4a47-bd46-5b7769f7bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.677632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf99a-ff03-4a47-bd46-5b7769f7bc4a admin admin] PATH_INFO: `/v3/projects/63b67212ab2d49b882997bb13e10c87e/users/c170d4cece45442b802136e9a0e43aae/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.691732 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf99a-ff03-4a47-bd46-5b7769f7bc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b67212ab2d49b882997bb13e10c87e, user_id=c170d4cece45442b802136e9a0e43aae, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:32.694406 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf99a-ff03-4a47-bd46-5b7769f7bc4a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:32.708340 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1355/2699] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:32 2022] PUT /identity/v3/projects/63b67212ab2d49b882997bb13e10c87e/users/c170d4cece45442b802136e9a0e43aae/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:18:32.720207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893f458-f680-4500-8aab-e9765473664b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.720742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893f458-f680-4500-8aab-e9765473664b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.720866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893f458-f680-4500-8aab-e9765473664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.749001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9893f458-f680-4500-8aab-e9765473664b None None] MFA Rules not processed for user `c170d4cece45442b802136e9a0e43aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:32.750214 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9893f458-f680-4500-8aab-e9765473664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:32.813186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1345/2700] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:32.817715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf99a-ff03-4a47-bd46-5b7769f7bc4a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:32.880793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf99a-ff03-4a47-bd46-5b7769f7bc4a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:32.885803 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de259866-6812-417e-acb1-8fb8d73fb5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:32.886448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259866-6812-417e-acb1-8fb8d73fb5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.887306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259866-6812-417e-acb1-8fb8d73fb5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.887695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259866-6812-417e-acb1-8fb8d73fb5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.888368 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de259866-6812-417e-acb1-8fb8d73fb5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:32.890305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de259866-6812-417e-acb1-8fb8d73fb5e2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:32.916857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1356/2701] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:32 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:32.921565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893f458-f680-4500-8aab-e9765473664b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:32.932016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893f458-f680-4500-8aab-e9765473664b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:32.941181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:32.991111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0b52-530f-476b-add7-ec78a40fda82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:32.991718 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0b52-530f-476b-add7-ec78a40fda82 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:32.991996 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0b52-530f-476b-add7-ec78a40fda82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:32.992268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0b52-530f-476b-add7-ec78a40fda82 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:32.992928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a0b52-530f-476b-add7-ec78a40fda82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:32.994850 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a0b52-530f-476b-add7-ec78a40fda82 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:33.015631 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1346/2702] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:32 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:18:33.019650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de259866-6812-417e-acb1-8fb8d73fb5e2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:33.030579 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de259866-6812-417e-acb1-8fb8d73fb5e2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:33.035205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcb45f-ca27-4efa-80f7-b8dda6889936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:33.035800 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcb45f-ca27-4efa-80f7-b8dda6889936 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:33.036084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcb45f-ca27-4efa-80f7-b8dda6889936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:33.036387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcb45f-ca27-4efa-80f7-b8dda6889936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:33.037031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcb45f-ca27-4efa-80f7-b8dda6889936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:33.038630 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcb45f-ca27-4efa-80f7-b8dda6889936 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:33.049772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1357/2703] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:33.053905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0b52-530f-476b-add7-ec78a40fda82 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:33.063882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0b52-530f-476b-add7-ec78a40fda82 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:33.068493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7bdb-bcc4-4d88-9c5e-58df39486e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:33.069130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7bdb-bcc4-4d88-9c5e-58df39486e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:33.069410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7bdb-bcc4-4d88-9c5e-58df39486e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:33.069683 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7bdb-bcc4-4d88-9c5e-58df39486e74 admin admin] PATH_INFO: `/v3/projects/5cdbe93f005144f486557607bd37e97c/users/69c2185640404affb75fc0ab6900e6f7/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:33.084407 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa7bdb-bcc4-4d88-9c5e-58df39486e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdbe93f005144f486557607bd37e97c, user_id=69c2185640404affb75fc0ab6900e6f7, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:33.087123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa7bdb-bcc4-4d88-9c5e-58df39486e74 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:33.100011 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1347/2704] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:33 2022] PUT /identity/v3/projects/5cdbe93f005144f486557607bd37e97c/users/69c2185640404affb75fc0ab6900e6f7/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:18:33.103862 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcb45f-ca27-4efa-80f7-b8dda6889936 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:33.114560 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcb45f-ca27-4efa-80f7-b8dda6889936 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:33.161962 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:33.173371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a01e55-b1bb-4b7b-aaec-9ec7cb40b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:33.173979 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a01e55-b1bb-4b7b-aaec-9ec7cb40b752 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:33.174259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a01e55-b1bb-4b7b-aaec-9ec7cb40b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:33.174533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a01e55-b1bb-4b7b-aaec-9ec7cb40b752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:33.175177 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a01e55-b1bb-4b7b-aaec-9ec7cb40b752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:33.176799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a01e55-b1bb-4b7b-aaec-9ec7cb40b752 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:33.186716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1358/2705] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:33.190916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7bdb-bcc4-4d88-9c5e-58df39486e74 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:33.201542 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7bdb-bcc4-4d88-9c5e-58df39486e74 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:33.206254 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28208973-7dde-4ced-90f9-23796df70cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:33.206948 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28208973-7dde-4ced-90f9-23796df70cff admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:33.207233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28208973-7dde-4ced-90f9-23796df70cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:33.207513 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28208973-7dde-4ced-90f9-23796df70cff admin admin] PATH_INFO: `/v3/projects/5cdbe93f005144f486557607bd37e97c/users/69c2185640404affb75fc0ab6900e6f7/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:33.209485 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28208973-7dde-4ced-90f9-23796df70cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdbe93f005144f486557607bd37e97c, user_id=69c2185640404affb75fc0ab6900e6f7, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:33.212146 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28208973-7dde-4ced-90f9-23796df70cff admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:33.222800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1348/2706] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:33 2022] PUT /identity/v3/projects/5cdbe93f005144f486557607bd37e97c/users/69c2185640404affb75fc0ab6900e6f7/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:18:33.234517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681ba0-c177-461a-883b-29b8f43a310c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:33.234805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681ba0-c177-461a-883b-29b8f43a310c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:33.235083 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681ba0-c177-461a-883b-29b8f43a310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:33.263296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ba681ba0-c177-461a-883b-29b8f43a310c None None] MFA Rules not processed for user `69c2185640404affb75fc0ab6900e6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:33.264534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ba681ba0-c177-461a-883b-29b8f43a310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:33.332658 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1359/2707] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:33.344814 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28208973-7dde-4ced-90f9-23796df70cff admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:33.346526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-28208973-7dde-4ced-90f9-23796df70cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:33.404622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28208973-7dde-4ced-90f9-23796df70cff admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:33.408541 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbf3b-b8b0-4555-afdd-1f260bad72f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:33.409150 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbf3b-b8b0-4555-afdd-1f260bad72f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:33.409430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbf3b-b8b0-4555-afdd-1f260bad72f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:33.409702 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbf3b-b8b0-4555-afdd-1f260bad72f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:33.422116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fbf3b-b8b0-4555-afdd-1f260bad72f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:33.423621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fbf3b-b8b0-4555-afdd-1f260bad72f8 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:33.435245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1349/2708] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:33.527709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba681ba0-c177-461a-883b-29b8f43a310c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:33.537516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba681ba0-c177-461a-883b-29b8f43a310c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:33.541554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6596-97a8-4aca-ba55-85e1f5bf781d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:33.542180 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6596-97a8-4aca-ba55-85e1f5bf781d service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:33.542937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6596-97a8-4aca-ba55-85e1f5bf781d service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:33.543221 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6596-97a8-4aca-ba55-85e1f5bf781d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:33.608102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6596-97a8-4aca-ba55-85e1f5bf781d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:33.609595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6596-97a8-4aca-ba55-85e1f5bf781d service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:33.620485 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1360/2709] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:38.401456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbf3b-b8b0-4555-afdd-1f260bad72f8 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:38.464202 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbf3b-b8b0-4555-afdd-1f260bad72f8 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:38.469420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:38.470044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:38.470327 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:38.470609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] PATH_INFO: `/v3/users/c170d4cece45442b802136e9a0e43aae` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:38.471719 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c170d4cece45442b802136e9a0e43aae)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:38.473646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:38.484203 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:38.520259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c170d4cece45442b802136e9a0e43aae'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:38.520939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c170d4cece45442b802136e9a0e43aae'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:38.528626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c170d4cece45442b802136e9a0e43aae'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:38.540264 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c170d4cece45442b802136e9a0e43aae'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:38.550062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c170d4cece45442b802136e9a0e43aae'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:38.556247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1350/2710] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:38 2022] DELETE /identity/v3/users/c170d4cece45442b802136e9a0e43aae => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:18:38.560972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433cf6b-7339-4f53-a8e3-159a29c93653 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:38.561445 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433cf6b-7339-4f53-a8e3-159a29c93653 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:38.561562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433cf6b-7339-4f53-a8e3-159a29c93653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:38.582760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4433cf6b-7339-4f53-a8e3-159a29c93653 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:38.583958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4433cf6b-7339-4f53-a8e3-159a29c93653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:38.642436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1361/2711] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:38.652414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:38.654534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:38.713383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5980d00-a338-4e0a-8bee-dd46026c4628 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:38.719895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed1194-645d-4f4c-982a-56072a819a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:38.719895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed1194-645d-4f4c-982a-56072a819a33 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:38.719895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed1194-645d-4f4c-982a-56072a819a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:38.719895 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed1194-645d-4f4c-982a-56072a819a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:38.729194 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed1194-645d-4f4c-982a-56072a819a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:38.730619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed1194-645d-4f4c-982a-56072a819a33 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:38.740577 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1351/2712] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:38.998619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433cf6b-7339-4f53-a8e3-159a29c93653 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:39.000309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4433cf6b-7339-4f53-a8e3-159a29c93653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:39.018992 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433cf6b-7339-4f53-a8e3-159a29c93653 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:39.024088 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:39.024900 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:39.025238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:39.025430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] PATH_INFO: `/v3/projects/63b67212ab2d49b882997bb13e10c87e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:39.026511 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b67212ab2d49b882997bb13e10c87e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:39.028528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:39.037342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:39.092359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b67212ab2d49b882997bb13e10c87e', 'request_id': 'req-c19030cc-3f28-4604-9fbd-ade43730c896'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.097850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b67212ab2d49b882997bb13e10c87e', 'request_id': 'req-c19030cc-3f28-4604-9fbd-ade43730c896'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.103975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b67212ab2d49b882997bb13e10c87e', 'request_id': 'req-c19030cc-3f28-4604-9fbd-ade43730c896'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.115235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] The token cache is being invalidate because project 63b67212ab2d49b882997bb13e10c87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:39.115530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.116155 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.117668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1362/2713] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:38 2022] DELETE /identity/v3/projects/63b67212ab2d49b882997bb13e10c87e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:39.122489 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed1194-645d-4f4c-982a-56072a819a33 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:39.133269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed1194-645d-4f4c-982a-56072a819a33 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:39.190498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:39.191063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:39.191348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:39.191626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] PATH_INFO: `/v3/users/69c2185640404affb75fc0ab6900e6f7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:39.192819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c2185640404affb75fc0ab6900e6f7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:39.194747 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:39.228279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:39.242295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c2185640404affb75fc0ab6900e6f7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.242939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c2185640404affb75fc0ab6900e6f7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.249932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c2185640404affb75fc0ab6900e6f7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.262119 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c2185640404affb75fc0ab6900e6f7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.269376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9dfda19f-cef4-47d8-9b5b-23470e6c5b80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c2185640404affb75fc0ab6900e6f7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.275244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1352/2714] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:39 2022] DELETE /identity/v3/users/69c2185640404affb75fc0ab6900e6f7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:39.547308 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:39.548853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:39.562858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19030cc-3f28-4604-9fbd-ade43730c896 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:39.619384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:39.620020 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:39.620304 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:39.620614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] PATH_INFO: `/v3/projects/5cdbe93f005144f486557607bd37e97c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:39.622241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cdbe93f005144f486557607bd37e97c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:39.624152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:39.671216 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cdbe93f005144f486557607bd37e97c', 'request_id': 'req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.676686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cdbe93f005144f486557607bd37e97c', 'request_id': 'req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.682683 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cdbe93f005144f486557607bd37e97c', 'request_id': 'req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.695540 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] The token cache is being invalidate because project 5cdbe93f005144f486557607bd37e97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:39.695832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.696499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-605acb4e-22c1-44e8-b316-b94cb1ed0ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:39.697985 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1363/2715] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:39 2022] DELETE /identity/v3/projects/5cdbe93f005144f486557607bd37e97c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:39.703819 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064ee8-efe6-4c54-994f-b0c51089e792 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:39.704314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064ee8-efe6-4c54-994f-b0c51089e792 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:39.704459 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064ee8-efe6-4c54-994f-b0c51089e792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:39.724622 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ef064ee8-efe6-4c54-994f-b0c51089e792 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:39.725753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ef064ee8-efe6-4c54-994f-b0c51089e792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:39.786600 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1353/2716] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:39.794833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4963-cff8-4b4d-8415-e814cda35994 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:39.795124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4963-cff8-4b4d-8415-e814cda35994 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:39.795403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4963-cff8-4b4d-8415-e814cda35994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:39.814850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5fee4963-cff8-4b4d-8415-e814cda35994 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:39.816045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5fee4963-cff8-4b4d-8415-e814cda35994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:39.823856 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1364/2717] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:39.828241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef064ee8-efe6-4c54-994f-b0c51089e792 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:39.837902 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef064ee8-efe6-4c54-994f-b0c51089e792 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:39.843063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267711f3-58fd-43a7-9387-39eb02cc018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:39.843651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267711f3-58fd-43a7-9387-39eb02cc018f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:39.843930 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267711f3-58fd-43a7-9387-39eb02cc018f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:39.844204 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267711f3-58fd-43a7-9387-39eb02cc018f admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:39.844879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267711f3-58fd-43a7-9387-39eb02cc018f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:18:39.845182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267711f3-58fd-43a7-9387-39eb02cc018f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:39.846791 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267711f3-58fd-43a7-9387-39eb02cc018f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:39.858539 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1354/2718] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:18:39.862669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4963-cff8-4b4d-8415-e814cda35994 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:39.871835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4963-cff8-4b4d-8415-e814cda35994 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:39.876671 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d867d-45a9-4021-94ab-09429b3e45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:39.877272 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d867d-45a9-4021-94ab-09429b3e45a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:39.877551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d867d-45a9-4021-94ab-09429b3e45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:39.877823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d867d-45a9-4021-94ab-09429b3e45a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:39.878446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d867d-45a9-4021-94ab-09429b3e45a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:39.880354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d867d-45a9-4021-94ab-09429b3e45a3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:39.900291 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:39.911266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1365/2719] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:39 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:39.913049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267711f3-58fd-43a7-9387-39eb02cc018f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:39.923765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267711f3-58fd-43a7-9387-39eb02cc018f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:39.978875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45ffe3-2318-457f-94a2-39949ecf2629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:39.979399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45ffe3-2318-457f-94a2-39949ecf2629 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:39.979678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45ffe3-2318-457f-94a2-39949ecf2629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:39.979953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45ffe3-2318-457f-94a2-39949ecf2629 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:39.980618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45ffe3-2318-457f-94a2-39949ecf2629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:39.983059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45ffe3-2318-457f-94a2-39949ecf2629 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:40.004293 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1355/2720] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:39 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:18:40.008546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d867d-45a9-4021-94ab-09429b3e45a3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:40.019432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d867d-45a9-4021-94ab-09429b3e45a3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:40.024077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d656f-d5fb-4e3d-b052-9ffa2537c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:40.024699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d656f-d5fb-4e3d-b052-9ffa2537c5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:40.024978 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d656f-d5fb-4e3d-b052-9ffa2537c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:40.025260 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d656f-d5fb-4e3d-b052-9ffa2537c5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:40.025885 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d656f-d5fb-4e3d-b052-9ffa2537c5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:40.027462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d656f-d5fb-4e3d-b052-9ffa2537c5ce admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:40.037904 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1366/2721] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:40.041776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45ffe3-2318-457f-94a2-39949ecf2629 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:40.051853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45ffe3-2318-457f-94a2-39949ecf2629 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:40.056520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bb87f-75cb-4035-b203-b08e8e6f727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:40.057114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bb87f-75cb-4035-b203-b08e8e6f727b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:40.057398 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bb87f-75cb-4035-b203-b08e8e6f727b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:40.057677 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bb87f-75cb-4035-b203-b08e8e6f727b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:40.058318 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bb87f-75cb-4035-b203-b08e8e6f727b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:40.060051 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bb87f-75cb-4035-b203-b08e8e6f727b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:40.070567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1356/2722] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:40.075241 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d656f-d5fb-4e3d-b052-9ffa2537c5ce admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:40.086045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d656f-d5fb-4e3d-b052-9ffa2537c5ce admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:40.091789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662fa4d-eaf0-411d-b330-e4d97403b541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:40.092477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662fa4d-eaf0-411d-b330-e4d97403b541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:40.092763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662fa4d-eaf0-411d-b330-e4d97403b541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:40.093039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662fa4d-eaf0-411d-b330-e4d97403b541 admin admin] PATH_INFO: `/v3/projects/c437065ebecc4059ad6d11aaf6709612/users/115f182bad7f43c48f475b6246ded06e/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:40.107646 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662fa4d-eaf0-411d-b330-e4d97403b541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c437065ebecc4059ad6d11aaf6709612, user_id=115f182bad7f43c48f475b6246ded06e, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:40.110363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662fa4d-eaf0-411d-b330-e4d97403b541 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:40.123047 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1367/2723] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:40 2022] PUT /identity/v3/projects/c437065ebecc4059ad6d11aaf6709612/users/115f182bad7f43c48f475b6246ded06e/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:40.133353 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2f063-fb03-4c9c-a3b4-a40d49b8d729 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:40.133646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2f063-fb03-4c9c-a3b4-a40d49b8d729 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:40.133925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2f063-fb03-4c9c-a3b4-a40d49b8d729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:40.163660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-35a2f063-fb03-4c9c-a3b4-a40d49b8d729 None None] MFA Rules not processed for user `115f182bad7f43c48f475b6246ded06e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:40.164925 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-35a2f063-fb03-4c9c-a3b4-a40d49b8d729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:40.169029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:40.231743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1357/2724] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:40.242339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662fa4d-eaf0-411d-b330-e4d97403b541 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:40.244061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8662fa4d-eaf0-411d-b330-e4d97403b541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:40.301039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662fa4d-eaf0-411d-b330-e4d97403b541 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:40.304703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997d034-2ba8-4e06-90ee-b28e3e57b666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:40.305306 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d034-2ba8-4e06-90ee-b28e3e57b666 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:40.305586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d034-2ba8-4e06-90ee-b28e3e57b666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:40.305857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d034-2ba8-4e06-90ee-b28e3e57b666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:40.313996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997d034-2ba8-4e06-90ee-b28e3e57b666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:40.315415 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997d034-2ba8-4e06-90ee-b28e3e57b666 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:40.324058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1368/2725] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:45.633762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2f063-fb03-4c9c-a3b4-a40d49b8d729 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:45.695217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2f063-fb03-4c9c-a3b4-a40d49b8d729 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:45.699763 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:45.700968 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:45.701568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:45.701843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] PATH_INFO: `/v3/users/115f182bad7f43c48f475b6246ded06e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:45.702961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=115f182bad7f43c48f475b6246ded06e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:45.704907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:45.751195 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115f182bad7f43c48f475b6246ded06e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:45.751845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115f182bad7f43c48f475b6246ded06e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:45.758970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115f182bad7f43c48f475b6246ded06e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:45.771436 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115f182bad7f43c48f475b6246ded06e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:45.778163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115f182bad7f43c48f475b6246ded06e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:45.784375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1358/2726] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:45 2022] DELETE /identity/v3/users/115f182bad7f43c48f475b6246ded06e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:45.788876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370fe53-764a-4735-993d-6498141cd58c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:45.789371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370fe53-764a-4735-993d-6498141cd58c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:45.789473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370fe53-764a-4735-993d-6498141cd58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:45.808407 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1370fe53-764a-4735-993d-6498141cd58c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:45.810174 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1370fe53-764a-4735-993d-6498141cd58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:45.868224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1369/2727] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:45.878384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:45.879846 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:45.908551 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:45.939339 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af608fc0-1236-4cf9-914a-1d6c31305181 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:45.942984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30404829-f92c-4eda-bd40-83b35491973c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:45.943584 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30404829-f92c-4eda-bd40-83b35491973c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:45.943866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30404829-f92c-4eda-bd40-83b35491973c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:45.944140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30404829-f92c-4eda-bd40-83b35491973c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:45.954086 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30404829-f92c-4eda-bd40-83b35491973c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:45.955517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30404829-f92c-4eda-bd40-83b35491973c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:45.964785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1359/2728] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:46.240126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370fe53-764a-4735-993d-6498141cd58c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:46.241914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1370fe53-764a-4735-993d-6498141cd58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:46.257694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370fe53-764a-4735-993d-6498141cd58c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:46.262459 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:46.263648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:46.264077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:46.264553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] PATH_INFO: `/v3/projects/c437065ebecc4059ad6d11aaf6709612` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:46.265706 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c437065ebecc4059ad6d11aaf6709612)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:46.267618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:46.315393 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c437065ebecc4059ad6d11aaf6709612', 'request_id': 'req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:46.320902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c437065ebecc4059ad6d11aaf6709612', 'request_id': 'req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:46.322926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:46.328668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c437065ebecc4059ad6d11aaf6709612', 'request_id': 'req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:46.342030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] The token cache is being invalidate because project c437065ebecc4059ad6d11aaf6709612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:46.342352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:46.342971 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf4974bb-6364-47ab-8d9e-91dd10d9bc44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:46.344486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1370/2729] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:46 2022] DELETE /identity/v3/projects/c437065ebecc4059ad6d11aaf6709612 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:46.349271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f5658-7e6e-41b3-8b15-df8ba04c82e2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:46.349557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f5658-7e6e-41b3-8b15-df8ba04c82e2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:46.349831 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f5658-7e6e-41b3-8b15-df8ba04c82e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:46.370674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-674f5658-7e6e-41b3-8b15-df8ba04c82e2 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:46.372169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-674f5658-7e6e-41b3-8b15-df8ba04c82e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:46.437838 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1360/2730] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:18:46.445614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d2570-3b38-4e1e-b4d7-ea39ce5a3c4f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:46.445910 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d2570-3b38-4e1e-b4d7-ea39ce5a3c4f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:46.446194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d2570-3b38-4e1e-b4d7-ea39ce5a3c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:46.466999 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b06d2570-3b38-4e1e-b4d7-ea39ce5a3c4f None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:46.468201 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b06d2570-3b38-4e1e-b4d7-ea39ce5a3c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:46.476084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1371/2731] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:46.480233 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f5658-7e6e-41b3-8b15-df8ba04c82e2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:46.490484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f5658-7e6e-41b3-8b15-df8ba04c82e2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:46.495101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf00369-b0e9-4614-b699-40446b651836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:46.495692 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00369-b0e9-4614-b699-40446b651836 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:46.495970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00369-b0e9-4614-b699-40446b651836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:46.496242 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00369-b0e9-4614-b699-40446b651836 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:46.497014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf00369-b0e9-4614-b699-40446b651836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:18:46.497314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf00369-b0e9-4614-b699-40446b651836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:46.498944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf00369-b0e9-4614-b699-40446b651836 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:46.510180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1361/2732] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:18:46.514323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d2570-3b38-4e1e-b4d7-ea39ce5a3c4f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:46.523537 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d2570-3b38-4e1e-b4d7-ea39ce5a3c4f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:46.528768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b150c0-7edb-4c9f-951b-6ea2a287f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:46.529366 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b150c0-7edb-4c9f-951b-6ea2a287f421 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:46.529647 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b150c0-7edb-4c9f-951b-6ea2a287f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:46.529924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b150c0-7edb-4c9f-951b-6ea2a287f421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:46.530557 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b150c0-7edb-4c9f-951b-6ea2a287f421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:46.532490 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b150c0-7edb-4c9f-951b-6ea2a287f421 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:46.559354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1372/2733] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:46 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:46.563502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf00369-b0e9-4614-b699-40446b651836 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:46.573306 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf00369-b0e9-4614-b699-40446b651836 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:46.629169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eebe79-43af-415a-a826-3b7298ef6141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:46.629693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eebe79-43af-415a-a826-3b7298ef6141 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:46.629975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eebe79-43af-415a-a826-3b7298ef6141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:46.630247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eebe79-43af-415a-a826-3b7298ef6141 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:46.630877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eebe79-43af-415a-a826-3b7298ef6141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:46.632817 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eebe79-43af-415a-a826-3b7298ef6141 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:46.653801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1362/2734] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:46 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:18:46.658302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b150c0-7edb-4c9f-951b-6ea2a287f421 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:46.669581 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b150c0-7edb-4c9f-951b-6ea2a287f421 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:46.674488 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530501-f1f7-4e98-a88a-35b6cfc00a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:46.675089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530501-f1f7-4e98-a88a-35b6cfc00a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:46.675371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530501-f1f7-4e98-a88a-35b6cfc00a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:46.675643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530501-f1f7-4e98-a88a-35b6cfc00a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:46.676284 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01530501-f1f7-4e98-a88a-35b6cfc00a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:46.677907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01530501-f1f7-4e98-a88a-35b6cfc00a9c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:46.688168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1373/2735] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:46.692278 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eebe79-43af-415a-a826-3b7298ef6141 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:46.703384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eebe79-43af-415a-a826-3b7298ef6141 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:46.708123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fef2f-33ed-42ab-8905-dce0be806dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:46.708758 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fef2f-33ed-42ab-8905-dce0be806dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:46.709050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fef2f-33ed-42ab-8905-dce0be806dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:46.709324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fef2f-33ed-42ab-8905-dce0be806dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:46.709961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fef2f-33ed-42ab-8905-dce0be806dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:46.711567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fef2f-33ed-42ab-8905-dce0be806dd4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:46.723740 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1363/2736] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:46.727797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530501-f1f7-4e98-a88a-35b6cfc00a9c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:46.737964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530501-f1f7-4e98-a88a-35b6cfc00a9c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:46.742933 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcda01c-cb70-439a-b506-1985e488e891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:46.743586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcda01c-cb70-439a-b506-1985e488e891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:46.743896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcda01c-cb70-439a-b506-1985e488e891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:46.744171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcda01c-cb70-439a-b506-1985e488e891 admin admin] PATH_INFO: `/v3/projects/a834b2ee98f04c7a8854460f46f6378d/users/33a3aba043e64cd0bc4730ea4ba2413e/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:46.758552 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcda01c-cb70-439a-b506-1985e488e891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a834b2ee98f04c7a8854460f46f6378d, user_id=33a3aba043e64cd0bc4730ea4ba2413e, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:46.761250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcda01c-cb70-439a-b506-1985e488e891 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:46.774061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1374/2737] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:46 2022] PUT /identity/v3/projects/a834b2ee98f04c7a8854460f46f6378d/users/33a3aba043e64cd0bc4730ea4ba2413e/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:46.785044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b4e9-2d63-4c64-b70f-db0ad7104cf0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:46.785332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b4e9-2d63-4c64-b70f-db0ad7104cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:46.785609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b4e9-2d63-4c64-b70f-db0ad7104cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:46.935885 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3ef2b4e9-2d63-4c64-b70f-db0ad7104cf0 None None] MFA Rules not processed for user `33a3aba043e64cd0bc4730ea4ba2413e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:46.937209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3ef2b4e9-2d63-4c64-b70f-db0ad7104cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:46.962066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:47.007236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1364/2738] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:47.011841 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcda01c-cb70-439a-b506-1985e488e891 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.071701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcda01c-cb70-439a-b506-1985e488e891 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.076668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b42d-7145-49fb-91a0-c16fa480d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.077268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b42d-7145-49fb-91a0-c16fa480d450 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.077548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b42d-7145-49fb-91a0-c16fa480d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.077821 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b42d-7145-49fb-91a0-c16fa480d450 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.078454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200b42d-7145-49fb-91a0-c16fa480d450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.080441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200b42d-7145-49fb-91a0-c16fa480d450 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.110385 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1375/2739] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:47 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:47.114568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2b4e9-2d63-4c64-b70f-db0ad7104cf0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.125286 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2b4e9-2d63-4c64-b70f-db0ad7104cf0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.180738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30defda4-e451-495e-94d8-2ce5b44e3f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.181271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30defda4-e451-495e-94d8-2ce5b44e3f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.181550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30defda4-e451-495e-94d8-2ce5b44e3f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.181821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30defda4-e451-495e-94d8-2ce5b44e3f64 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.182441 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30defda4-e451-495e-94d8-2ce5b44e3f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.186029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30defda4-e451-495e-94d8-2ce5b44e3f64 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.208067 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1365/2740] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:47 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:47.212023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b42d-7145-49fb-91a0-c16fa480d450 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.222740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b42d-7145-49fb-91a0-c16fa480d450 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.227277 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42dc30-910e-41af-8e21-81deccd8c52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.227873 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42dc30-910e-41af-8e21-81deccd8c52b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.228153 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42dc30-910e-41af-8e21-81deccd8c52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.228470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42dc30-910e-41af-8e21-81deccd8c52b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.229107 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42dc30-910e-41af-8e21-81deccd8c52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.230707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42dc30-910e-41af-8e21-81deccd8c52b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.243271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1376/2741] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:47.247335 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30defda4-e451-495e-94d8-2ce5b44e3f64 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.257062 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30defda4-e451-495e-94d8-2ce5b44e3f64 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.261625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19950fd-dc74-4da8-94a8-9ef89e518f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.262212 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19950fd-dc74-4da8-94a8-9ef89e518f0d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.262523 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19950fd-dc74-4da8-94a8-9ef89e518f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.262798 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19950fd-dc74-4da8-94a8-9ef89e518f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.263434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19950fd-dc74-4da8-94a8-9ef89e518f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.265052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19950fd-dc74-4da8-94a8-9ef89e518f0d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.275083 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1366/2742] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:47.279570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42dc30-910e-41af-8e21-81deccd8c52b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.289670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42dc30-910e-41af-8e21-81deccd8c52b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.295038 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107ae1b-46b6-454e-9a3c-2055ecdbe4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.295689 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ae1b-46b6-454e-9a3c-2055ecdbe4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.295971 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ae1b-46b6-454e-9a3c-2055ecdbe4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.296249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ae1b-46b6-454e-9a3c-2055ecdbe4d7 admin admin] PATH_INFO: `/v3/projects/f37cd834f1bb410ca09e829ea6664a1d/users/f8bc7e4f1510458b8f2afa5242b39fe2/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.311294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107ae1b-46b6-454e-9a3c-2055ecdbe4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37cd834f1bb410ca09e829ea6664a1d, user_id=f8bc7e4f1510458b8f2afa5242b39fe2, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.314080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107ae1b-46b6-454e-9a3c-2055ecdbe4d7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.327686 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1377/2743] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:47 2022] PUT /identity/v3/projects/f37cd834f1bb410ca09e829ea6664a1d/users/f8bc7e4f1510458b8f2afa5242b39fe2/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:47.338954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919164-ad85-4abd-99b0-5ea8954a23af None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.339268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919164-ad85-4abd-99b0-5ea8954a23af None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.339572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919164-ad85-4abd-99b0-5ea8954a23af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.366441 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1c919164-ad85-4abd-99b0-5ea8954a23af None None] MFA Rules not processed for user `f8bc7e4f1510458b8f2afa5242b39fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:47.367642 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1c919164-ad85-4abd-99b0-5ea8954a23af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:47.429739 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1367/2744] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:47.434964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107ae1b-46b6-454e-9a3c-2055ecdbe4d7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.474787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:47.500039 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107ae1b-46b6-454e-9a3c-2055ecdbe4d7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.505022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee572ac8-44a0-4517-86d8-dd6180e59a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.505657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee572ac8-44a0-4517-86d8-dd6180e59a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.506057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee572ac8-44a0-4517-86d8-dd6180e59a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.506337 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee572ac8-44a0-4517-86d8-dd6180e59a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.506972 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee572ac8-44a0-4517-86d8-dd6180e59a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.508948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee572ac8-44a0-4517-86d8-dd6180e59a3b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.534496 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1378/2745] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:47 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:47.538685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c919164-ad85-4abd-99b0-5ea8954a23af None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.549939 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c919164-ad85-4abd-99b0-5ea8954a23af None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.579009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:47.607607 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6f67d-1359-41b6-b7ef-6177c70da849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.608209 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6f67d-1359-41b6-b7ef-6177c70da849 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.608526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6f67d-1359-41b6-b7ef-6177c70da849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.608799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6f67d-1359-41b6-b7ef-6177c70da849 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.609420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6f67d-1359-41b6-b7ef-6177c70da849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.611323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6f67d-1359-41b6-b7ef-6177c70da849 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.632004 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1368/2746] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:47 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:47.636197 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee572ac8-44a0-4517-86d8-dd6180e59a3b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.646966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee572ac8-44a0-4517-86d8-dd6180e59a3b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.651576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df6131-1bb9-477b-a360-288f7363befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.652164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df6131-1bb9-477b-a360-288f7363befc admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.652486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df6131-1bb9-477b-a360-288f7363befc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.652763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df6131-1bb9-477b-a360-288f7363befc admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.654264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df6131-1bb9-477b-a360-288f7363befc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.655849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df6131-1bb9-477b-a360-288f7363befc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.666251 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1379/2747] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:47.671173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6f67d-1359-41b6-b7ef-6177c70da849 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.681680 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6f67d-1359-41b6-b7ef-6177c70da849 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.686821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c487-9291-4cf4-a97e-0f4a5011aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.687410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c487-9291-4cf4-a97e-0f4a5011aea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.687689 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c487-9291-4cf4-a97e-0f4a5011aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.687962 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c487-9291-4cf4-a97e-0f4a5011aea9 admin admin] PATH_INFO: `/v3/projects/4e91c1f7a0e343cfbf525ffc147c6fa2/users/d116897aaadb4843b28c76b5524a3422/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.703912 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c487-9291-4cf4-a97e-0f4a5011aea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e91c1f7a0e343cfbf525ffc147c6fa2, user_id=d116897aaadb4843b28c76b5524a3422, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.706723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c487-9291-4cf4-a97e-0f4a5011aea9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.719865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1369/2748] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:47 2022] PUT /identity/v3/projects/4e91c1f7a0e343cfbf525ffc147c6fa2/users/d116897aaadb4843b28c76b5524a3422/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:18:47.723759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df6131-1bb9-477b-a360-288f7363befc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.734102 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df6131-1bb9-477b-a360-288f7363befc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.790466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d9e79-99e2-4d73-be27-ac529522b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.791080 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d9e79-99e2-4d73-be27-ac529522b6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.791367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d9e79-99e2-4d73-be27-ac529522b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.791643 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d9e79-99e2-4d73-be27-ac529522b6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.792287 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d9e79-99e2-4d73-be27-ac529522b6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.794101 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d9e79-99e2-4d73-be27-ac529522b6d1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.803761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1380/2749] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:47.807890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c487-9291-4cf4-a97e-0f4a5011aea9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.818235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c487-9291-4cf4-a97e-0f4a5011aea9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:47.822888 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694459-4187-4f4c-bb13-28886c146fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:47.823535 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694459-4187-4f4c-bb13-28886c146fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.823816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694459-4187-4f4c-bb13-28886c146fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.824114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694459-4187-4f4c-bb13-28886c146fb1 admin admin] PATH_INFO: `/v3/projects/4e91c1f7a0e343cfbf525ffc147c6fa2/users/d116897aaadb4843b28c76b5524a3422/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.826845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49694459-4187-4f4c-bb13-28886c146fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e91c1f7a0e343cfbf525ffc147c6fa2, user_id=d116897aaadb4843b28c76b5524a3422, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:47.829501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49694459-4187-4f4c-bb13-28886c146fb1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:47.839263 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1370/2750] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:47 2022] PUT /identity/v3/projects/4e91c1f7a0e343cfbf525ffc147c6fa2/users/d116897aaadb4843b28c76b5524a3422/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:47.850005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27254d17-e0a5-40f0-ac1b-98d0dd3a5ee2 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:47.850301 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27254d17-e0a5-40f0-ac1b-98d0dd3a5ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:47.850586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27254d17-e0a5-40f0-ac1b-98d0dd3a5ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:47.878196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-27254d17-e0a5-40f0-ac1b-98d0dd3a5ee2 None None] MFA Rules not processed for user `d116897aaadb4843b28c76b5524a3422`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:47.879412 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-27254d17-e0a5-40f0-ac1b-98d0dd3a5ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:47.945983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1381/2751] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:47.958103 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694459-4187-4f4c-bb13-28886c146fb1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:47.959779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-49694459-4187-4f4c-bb13-28886c146fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:48.016583 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694459-4187-4f4c-bb13-28886c146fb1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:48.020149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a041d2-0c50-493a-af1e-1489548dad6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:48.020783 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a041d2-0c50-493a-af1e-1489548dad6e service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:48.021066 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a041d2-0c50-493a-af1e-1489548dad6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:48.021341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a041d2-0c50-493a-af1e-1489548dad6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:48.079442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a041d2-0c50-493a-af1e-1489548dad6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:48.080917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a041d2-0c50-493a-af1e-1489548dad6e service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:48.090049 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1371/2752] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:49.581688 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27254d17-e0a5-40f0-ac1b-98d0dd3a5ee2 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:49.583098 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-27254d17-e0a5-40f0-ac1b-98d0dd3a5ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:49.595621 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27254d17-e0a5-40f0-ac1b-98d0dd3a5ee2 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:49.599212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2621-acf7-47d9-bf89-d5e3692f59fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:49.599808 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2621-acf7-47d9-bf89-d5e3692f59fd service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:49.600085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2621-acf7-47d9-bf89-d5e3692f59fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:49.600388 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2621-acf7-47d9-bf89-d5e3692f59fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:49.629297 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:49.658170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf2621-acf7-47d9-bf89-d5e3692f59fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:49.659538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf2621-acf7-47d9-bf89-d5e3692f59fd service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:49.668595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1382/2753] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:50.183863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a041d2-0c50-493a-af1e-1489548dad6e service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:50.192413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a041d2-0c50-493a-af1e-1489548dad6e service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:50.195956 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c4f51-828c-45d4-9ba5-907bed53490a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:50.196583 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c4f51-828c-45d4-9ba5-907bed53490a service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:50.196868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c4f51-828c-45d4-9ba5-907bed53490a service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:50.197135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c4f51-828c-45d4-9ba5-907bed53490a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:50.206361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c4f51-828c-45d4-9ba5-907bed53490a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:50.207755 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c4f51-828c-45d4-9ba5-907bed53490a service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:50.218376 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1372/2754] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:54.068124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2621-acf7-47d9-bf89-d5e3692f59fd service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:54.134838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2621-acf7-47d9-bf89-d5e3692f59fd service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:54.140307 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:54.140966 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:54.141250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:54.141528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] PATH_INFO: `/v3/users/33a3aba043e64cd0bc4730ea4ba2413e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:54.142657 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a3aba043e64cd0bc4730ea4ba2413e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:54.144662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:54.191897 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a3aba043e64cd0bc4730ea4ba2413e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.192580 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a3aba043e64cd0bc4730ea4ba2413e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.199576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a3aba043e64cd0bc4730ea4ba2413e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.207544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a3aba043e64cd0bc4730ea4ba2413e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.219492 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a3aba043e64cd0bc4730ea4ba2413e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.225354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1383/2755] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:54 2022] DELETE /identity/v3/users/33a3aba043e64cd0bc4730ea4ba2413e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:54.229769 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df330e6-d241-425e-81fe-118373b266ad None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:54.230250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df330e6-d241-425e-81fe-118373b266ad None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:54.230383 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df330e6-d241-425e-81fe-118373b266ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:54.251301 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9df330e6-d241-425e-81fe-118373b266ad None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:54.252442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9df330e6-d241-425e-81fe-118373b266ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:54.270262 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:54.312957 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1373/2756] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:18:54.322733 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:54.324137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:54.377596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:54.382183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68714aa4-90e3-4b2e-bbd7-b6318112d6b6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:54.387087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9076bf-1073-49e3-8c58-6200cc2525fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:54.387735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9076bf-1073-49e3-8c58-6200cc2525fa service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:54.388305 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9076bf-1073-49e3-8c58-6200cc2525fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:54.388670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9076bf-1073-49e3-8c58-6200cc2525fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:54.398528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9076bf-1073-49e3-8c58-6200cc2525fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:54.399971 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9076bf-1073-49e3-8c58-6200cc2525fa service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:54.409993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1384/2757] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:54.680267 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df330e6-d241-425e-81fe-118373b266ad None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:54.681721 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9df330e6-d241-425e-81fe-118373b266ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:54.694170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df330e6-d241-425e-81fe-118373b266ad None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:54.698736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:54.699400 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:54.699679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:54.699951 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] PATH_INFO: `/v3/projects/a834b2ee98f04c7a8854460f46f6378d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:54.701696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a834b2ee98f04c7a8854460f46f6378d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:54.703609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:54.753111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a834b2ee98f04c7a8854460f46f6378d', 'request_id': 'req-32d9b47e-5862-4c3e-8d26-d7603156875e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.758578 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a834b2ee98f04c7a8854460f46f6378d', 'request_id': 'req-32d9b47e-5862-4c3e-8d26-d7603156875e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.765349 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a834b2ee98f04c7a8854460f46f6378d', 'request_id': 'req-32d9b47e-5862-4c3e-8d26-d7603156875e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.776170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] The token cache is being invalidate because project a834b2ee98f04c7a8854460f46f6378d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:54.776493 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.777121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.779227 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1374/2758] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:54 2022] DELETE /identity/v3/projects/a834b2ee98f04c7a8854460f46f6378d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:54.783226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9076bf-1073-49e3-8c58-6200cc2525fa service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:54.792763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9076bf-1073-49e3-8c58-6200cc2525fa service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:54.849798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:54.850423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:54.850708 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:54.850983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] PATH_INFO: `/v3/users/f8bc7e4f1510458b8f2afa5242b39fe2` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:54.852107 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8bc7e4f1510458b8f2afa5242b39fe2)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:54.854067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:54.898959 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8bc7e4f1510458b8f2afa5242b39fe2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.899598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8bc7e4f1510458b8f2afa5242b39fe2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.907303 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8bc7e4f1510458b8f2afa5242b39fe2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.914342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8bc7e4f1510458b8f2afa5242b39fe2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.926687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8bc7e4f1510458b8f2afa5242b39fe2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:54.932566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1385/2759] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:54 2022] DELETE /identity/v3/users/f8bc7e4f1510458b8f2afa5242b39fe2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:55.195742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:55.197225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:55.211807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9b47e-5862-4c3e-8d26-d7603156875e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:55.269546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:55.270226 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:55.270470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:55.270743 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] PATH_INFO: `/v3/projects/f37cd834f1bb410ca09e829ea6664a1d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:55.271843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37cd834f1bb410ca09e829ea6664a1d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:55.273768 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:55.321009 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37cd834f1bb410ca09e829ea6664a1d', 'request_id': 'req-7aa96926-0235-4f3e-9f6d-3dae069346c5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.322090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:55.328460 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37cd834f1bb410ca09e829ea6664a1d', 'request_id': 'req-7aa96926-0235-4f3e-9f6d-3dae069346c5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.336112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37cd834f1bb410ca09e829ea6664a1d', 'request_id': 'req-7aa96926-0235-4f3e-9f6d-3dae069346c5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.346857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] The token cache is being invalidate because project f37cd834f1bb410ca09e829ea6664a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:55.347147 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.347789 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.349388 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1375/2760] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:55 2022] DELETE /identity/v3/projects/f37cd834f1bb410ca09e829ea6664a1d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:55.353400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:55.354781 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:55.367517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0502e4-10df-4602-9f6a-117617bcbbfb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:55.423202 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:55.423830 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:55.424111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:55.424413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] PATH_INFO: `/v3/users/d116897aaadb4843b28c76b5524a3422` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:55.425523 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d116897aaadb4843b28c76b5524a3422)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:55.427440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:55.440265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:55.476206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd116897aaadb4843b28c76b5524a3422'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.476893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd116897aaadb4843b28c76b5524a3422'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.484165 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd116897aaadb4843b28c76b5524a3422'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.491820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd116897aaadb4843b28c76b5524a3422'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.504194 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8627876e-284e-4373-a09e-b0d9e27b8128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd116897aaadb4843b28c76b5524a3422'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.510179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1386/2761] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:18:55 2022] DELETE /identity/v3/users/d116897aaadb4843b28c76b5524a3422 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:55.786399 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:55.787986 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:55.802041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa96926-0235-4f3e-9f6d-3dae069346c5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:55.862345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:55.862897 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:55.863180 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:55.863455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] PATH_INFO: `/v3/projects/4e91c1f7a0e343cfbf525ffc147c6fa2` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:55.864611 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e91c1f7a0e343cfbf525ffc147c6fa2)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:55.866526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:55.911961 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e91c1f7a0e343cfbf525ffc147c6fa2', 'request_id': 'req-edfc417c-7bbd-4535-8f19-8de992c38eca'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.917371 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e91c1f7a0e343cfbf525ffc147c6fa2', 'request_id': 'req-edfc417c-7bbd-4535-8f19-8de992c38eca'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.925544 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e91c1f7a0e343cfbf525ffc147c6fa2', 'request_id': 'req-edfc417c-7bbd-4535-8f19-8de992c38eca'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.937266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] The token cache is being invalidate because project 4e91c1f7a0e343cfbf525ffc147c6fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:18:55.937560 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.938237 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-edfc417c-7bbd-4535-8f19-8de992c38eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:18:55.939700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1376/2762] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:18:55 2022] DELETE /identity/v3/projects/4e91c1f7a0e343cfbf525ffc147c6fa2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:18:55.944586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6877c91-b077-4637-b818-6d1cc86c9be3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:55.944884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6877c91-b077-4637-b818-6d1cc86c9be3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:55.945169 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6877c91-b077-4637-b818-6d1cc86c9be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:55.965065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d6877c91-b077-4637-b818-6d1cc86c9be3 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:55.966310 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d6877c91-b077-4637-b818-6d1cc86c9be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:56.025033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1387/2763] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:56.033094 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b48bd-1fde-4574-b6c2-5ddc46c2459a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:56.033382 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b48bd-1fde-4574-b6c2-5ddc46c2459a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:56.033658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b48bd-1fde-4574-b6c2-5ddc46c2459a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:56.053223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7b1b48bd-1fde-4574-b6c2-5ddc46c2459a None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:56.054407 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7b1b48bd-1fde-4574-b6c2-5ddc46c2459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:56.065867 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1377/2764] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:56.070548 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6877c91-b077-4637-b818-6d1cc86c9be3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:56.081077 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6877c91-b077-4637-b818-6d1cc86c9be3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:56.085743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c5210-60a7-441d-9b50-524e34ccc3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:56.086350 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c5210-60a7-441d-9b50-524e34ccc3bd admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:56.086633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c5210-60a7-441d-9b50-524e34ccc3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:56.086911 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c5210-60a7-441d-9b50-524e34ccc3bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:56.087570 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c5210-60a7-441d-9b50-524e34ccc3bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:18:56.087879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c5210-60a7-441d-9b50-524e34ccc3bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:56.089519 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c5210-60a7-441d-9b50-524e34ccc3bd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:56.102302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1388/2765] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:18:56.107660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b48bd-1fde-4574-b6c2-5ddc46c2459a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:56.117265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b48bd-1fde-4574-b6c2-5ddc46c2459a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:56.121963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be11fb-c877-4e5d-af1a-5006016bc6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:56.122592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be11fb-c877-4e5d-af1a-5006016bc6df admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:56.122874 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be11fb-c877-4e5d-af1a-5006016bc6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:56.123152 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be11fb-c877-4e5d-af1a-5006016bc6df admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:56.123787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be11fb-c877-4e5d-af1a-5006016bc6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:56.125727 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be11fb-c877-4e5d-af1a-5006016bc6df admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:56.155907 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1378/2766] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:18:56 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:18:56.160280 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c5210-60a7-441d-9b50-524e34ccc3bd admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:56.171089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c5210-60a7-441d-9b50-524e34ccc3bd admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:56.227934 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60c97-2b07-4496-bb6f-d44911541969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:56.228585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60c97-2b07-4496-bb6f-d44911541969 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:56.228875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60c97-2b07-4496-bb6f-d44911541969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:56.229156 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60c97-2b07-4496-bb6f-d44911541969 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:56.229799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60c97-2b07-4496-bb6f-d44911541969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:56.232359 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60c97-2b07-4496-bb6f-d44911541969 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:56.255064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1389/2767] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:18:56 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:18:56.259732 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be11fb-c877-4e5d-af1a-5006016bc6df admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:56.270325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be11fb-c877-4e5d-af1a-5006016bc6df admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:56.275111 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd1b3-d315-4bed-bf43-383174339f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:56.275714 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd1b3-d315-4bed-bf43-383174339f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:56.276002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd1b3-d315-4bed-bf43-383174339f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:56.276273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd1b3-d315-4bed-bf43-383174339f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:56.276969 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cd1b3-d315-4bed-bf43-383174339f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:56.279106 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cd1b3-d315-4bed-bf43-383174339f1e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:56.289370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1379/2768] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:56.293373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60c97-2b07-4496-bb6f-d44911541969 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:56.304172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60c97-2b07-4496-bb6f-d44911541969 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:56.309117 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78a60b-3c61-4903-873e-2ffdff314728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:56.310715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a60b-3c61-4903-873e-2ffdff314728 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:56.311211 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a60b-3c61-4903-873e-2ffdff314728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:56.311551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a60b-3c61-4903-873e-2ffdff314728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:56.312233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78a60b-3c61-4903-873e-2ffdff314728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:56.313869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78a60b-3c61-4903-873e-2ffdff314728 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:56.315437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:56.328033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1390/2769] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:18:56.331894 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd1b3-d315-4bed-bf43-383174339f1e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:56.342903 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd1b3-d315-4bed-bf43-383174339f1e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:56.347517 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656adb88-a61f-4d0a-a7e9-085137061d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:56.348161 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656adb88-a61f-4d0a-a7e9-085137061d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:56.348486 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656adb88-a61f-4d0a-a7e9-085137061d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:56.348760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656adb88-a61f-4d0a-a7e9-085137061d74 admin admin] PATH_INFO: `/v3/projects/07a4a857708240d3a61f7647c18a92fc/users/fee8df3f7c084a92803d0a6f87f50afb/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:56.363822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656adb88-a61f-4d0a-a7e9-085137061d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a4a857708240d3a61f7647c18a92fc, user_id=fee8df3f7c084a92803d0a6f87f50afb, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:56.366501 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656adb88-a61f-4d0a-a7e9-085137061d74 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:56.379377 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1380/2770] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:18:56 2022] PUT /identity/v3/projects/07a4a857708240d3a61f7647c18a92fc/users/fee8df3f7c084a92803d0a6f87f50afb/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:18:56.384462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6982e0-84c3-439f-89f0-b45d4c7d2505 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:56.384924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6982e0-84c3-439f-89f0-b45d4c7d2505 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:56.385058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6982e0-84c3-439f-89f0-b45d4c7d2505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:56.404522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6b6982e0-84c3-439f-89f0-b45d4c7d2505 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:56.406064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6b6982e0-84c3-439f-89f0-b45d4c7d2505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:56.478376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1391/2771] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:56.489010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656adb88-a61f-4d0a-a7e9-085137061d74 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:56.491240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-656adb88-a61f-4d0a-a7e9-085137061d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:56.497855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:18:56.549217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656adb88-a61f-4d0a-a7e9-085137061d74 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:56.552805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885379c-9663-4e65-a812-259ac5f4060e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:56.553406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885379c-9663-4e65-a812-259ac5f4060e service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:56.553684 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885379c-9663-4e65-a812-259ac5f4060e service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:56.553955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885379c-9663-4e65-a812-259ac5f4060e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:56.562795 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885379c-9663-4e65-a812-259ac5f4060e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:56.564241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885379c-9663-4e65-a812-259ac5f4060e service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:56.573445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1381/2772] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:57.197777 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf75e60-30a9-454b-9f81-bdf532660389 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:57.198068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf75e60-30a9-454b-9f81-bdf532660389 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:57.198346 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf75e60-30a9-454b-9f81-bdf532660389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:57.227419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6cf75e60-30a9-454b-9f81-bdf532660389 None None] MFA Rules not processed for user `fee8df3f7c084a92803d0a6f87f50afb`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:57.228666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6cf75e60-30a9-454b-9f81-bdf532660389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:57.299976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1392/2773] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:57.311818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885379c-9663-4e65-a812-259ac5f4060e service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:57.313343 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1885379c-9663-4e65-a812-259ac5f4060e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:57.376592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885379c-9663-4e65-a812-259ac5f4060e service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:57.380344 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f583c6-7120-4a43-98d7-c503254dc0b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:57.380970 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f583c6-7120-4a43-98d7-c503254dc0b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:57.381255 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f583c6-7120-4a43-98d7-c503254dc0b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:57.381534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f583c6-7120-4a43-98d7-c503254dc0b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:57.391809 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f583c6-7120-4a43-98d7-c503254dc0b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:57.393630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f583c6-7120-4a43-98d7-c503254dc0b9 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:57.402849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1382/2774] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:58.783271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523dff-dbd6-4420-a376-e16ee86c89f4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:58.783799 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523dff-dbd6-4420-a376-e16ee86c89f4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:58.783902 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523dff-dbd6-4420-a376-e16ee86c89f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:58.807814 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-22523dff-dbd6-4420-a376-e16ee86c89f4 None None] MFA Rules not processed for user `fee8df3f7c084a92803d0a6f87f50afb`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:18:58.809058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-22523dff-dbd6-4420-a376-e16ee86c89f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:58.816774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1393/2775] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:18:59.053830 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f583c6-7120-4a43-98d7-c503254dc0b9 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:59.063967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f583c6-7120-4a43-98d7-c503254dc0b9 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:59.067549 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeea02c-1050-4cce-9b51-75022d75aa0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:59.068140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeea02c-1050-4cce-9b51-75022d75aa0d service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:59.068461 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeea02c-1050-4cce-9b51-75022d75aa0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:59.068744 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeea02c-1050-4cce-9b51-75022d75aa0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:59.070435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8aeea02c-1050-4cce-9b51-75022d75aa0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:59.080405 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeea02c-1050-4cce-9b51-75022d75aa0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:59.081822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeea02c-1050-4cce-9b51-75022d75aa0d service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:59.089862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1383/2776] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:18:59.651731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22523dff-dbd6-4420-a376-e16ee86c89f4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:18:59.653294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-22523dff-dbd6-4420-a376-e16ee86c89f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:59.725185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22523dff-dbd6-4420-a376-e16ee86c89f4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:18:59.730166 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2cf00-4799-41b4-9371-2183370f5e8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:18:59.730778 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2cf00-4799-41b4-9371-2183370f5e8f service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:18:59.731058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2cf00-4799-41b4-9371-2183370f5e8f service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:18:59.731330 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2cf00-4799-41b4-9371-2183370f5e8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:18:59.733189 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b9e2cf00-4799-41b4-9371-2183370f5e8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:18:59.745068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2cf00-4799-41b4-9371-2183370f5e8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:18:59.746659 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2cf00-4799-41b4-9371-2183370f5e8f service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:18:59.756744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1394/2777] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:18:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:19:01.491304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeea02c-1050-4cce-9b51-75022d75aa0d service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:01.500189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeea02c-1050-4cce-9b51-75022d75aa0d service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:01.503793 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c839a43-cff8-4fa1-abb6-7e89c826c2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:01.504413 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c839a43-cff8-4fa1-abb6-7e89c826c2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:01.504694 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c839a43-cff8-4fa1-abb6-7e89c826c2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:01.504967 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c839a43-cff8-4fa1-abb6-7e89c826c2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:01.506662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6c839a43-cff8-4fa1-abb6-7e89c826c2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:01.515954 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c839a43-cff8-4fa1-abb6-7e89c826c2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:01.517387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c839a43-cff8-4fa1-abb6-7e89c826c2b5 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:01.525338 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1384/2778] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:19:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:19:09.752385 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:11.521827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=62 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:14.324053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ec970-3e7d-47fe-ad71-955a9503ef22 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:14.324562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ec970-3e7d-47fe-ad71-955a9503ef22 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:14.324744 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ec970-3e7d-47fe-ad71-955a9503ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:14.344668 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d42ec970-3e7d-47fe-ad71-955a9503ef22 None None] MFA Rules not processed for user `fee8df3f7c084a92803d0a6f87f50afb`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:14.345878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d42ec970-3e7d-47fe-ad71-955a9503ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:14.353036 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1395/2779] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:23.762594 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c839a43-cff8-4fa1-abb6-7e89c826c2b5 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:23.764648 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6c839a43-cff8-4fa1-abb6-7e89c826c2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:23.842621 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c839a43-cff8-4fa1-abb6-7e89c826c2b5 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:23.848052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739692a5-0b1a-470e-9235-e8eab690b87d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99d74d9d72c4fc2a363ce6559e4ddff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:23.848686 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739692a5-0b1a-470e-9235-e8eab690b87d service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:23.848965 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739692a5-0b1a-470e-9235-e8eab690b87d service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:23.849241 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739692a5-0b1a-470e-9235-e8eab690b87d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:23.850934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-739692a5-0b1a-470e-9235-e8eab690b87d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:23.862859 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739692a5-0b1a-470e-9235-e8eab690b87d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:23.864451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739692a5-0b1a-470e-9235-e8eab690b87d service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:23.875276 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1385/2780] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:19:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:19:24.339254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:31.829970 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38c3fc-911f-4aa7-bb56-6e60425ee1e0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:31.830614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38c3fc-911f-4aa7-bb56-6e60425ee1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:31.830614 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38c3fc-911f-4aa7-bb56-6e60425ee1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:31.902592 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ec38c3fc-911f-4aa7-bb56-6e60425ee1e0 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:31.904554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ec38c3fc-911f-4aa7-bb56-6e60425ee1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:31.978380 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1396/2781] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Aug 31 01:19:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:32.029746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739692a5-0b1a-470e-9235-e8eab690b87d service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:32.031282 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-739692a5-0b1a-470e-9235-e8eab690b87d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:32.142213 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739692a5-0b1a-470e-9235-e8eab690b87d service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:32.147438 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d9ae3-2eaa-4b65-9e01-f8a7ce22c05c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:32.148056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d9ae3-2eaa-4b65-9e01-f8a7ce22c05c service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:32.148363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d9ae3-2eaa-4b65-9e01-f8a7ce22c05c service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:32.148691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d9ae3-2eaa-4b65-9e01-f8a7ce22c05c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:32.158378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d9ae3-2eaa-4b65-9e01-f8a7ce22c05c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:32.160020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d9ae3-2eaa-4b65-9e01-f8a7ce22c05c service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:32.168221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1386/2782] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:19:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:19:39.555878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38c3fc-911f-4aa7-bb56-6e60425ee1e0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:39.558009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ec38c3fc-911f-4aa7-bb56-6e60425ee1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:39.574820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38c3fc-911f-4aa7-bb56-6e60425ee1e0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:39.581339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:39.581991 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:39.582274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:39.582550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] PATH_INFO: `/v3/users/a7607c50966b458696e4ab9c741deef6` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:39.583707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7607c50966b458696e4ab9c741deef6)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:39.585807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:39.644467 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7607c50966b458696e4ab9c741deef6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:39.647502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7607c50966b458696e4ab9c741deef6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:39.660427 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7607c50966b458696e4ab9c741deef6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:39.670554 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7607c50966b458696e4ab9c741deef6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:39.687258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7c900151-fdc7-4927-b8a1-258834ced4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7607c50966b458696e4ab9c741deef6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:39.694731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1397/2783] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:19:39 2022] DELETE /identity/v3/users/a7607c50966b458696e4ab9c741deef6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:39.927044 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d9ae3-2eaa-4b65-9e01-f8a7ce22c05c service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:39.942977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d9ae3-2eaa-4b65-9e01-f8a7ce22c05c service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:40.041491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:40.051480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:40.052532 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:40.052908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:40.053447 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] PATH_INFO: `/v3/projects/419aeaadadd04744bf0e92580d06252b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:40.054767 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] RBAC: Authorizing `identity:delete_project(project_id=419aeaadadd04744bf0e92580d06252b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:40.056862 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:40.118554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419aeaadadd04744bf0e92580d06252b', 'request_id': 'req-65c11372-3f0c-48c1-b9e6-1cee845faaab'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:40.137392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419aeaadadd04744bf0e92580d06252b', 'request_id': 'req-65c11372-3f0c-48c1-b9e6-1cee845faaab'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:40.150337 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419aeaadadd04744bf0e92580d06252b', 'request_id': 'req-65c11372-3f0c-48c1-b9e6-1cee845faaab'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:40.164162 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] The token cache is being invalidate because project 419aeaadadd04744bf0e92580d06252b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:19:40.164537 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:40.165303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-65c11372-3f0c-48c1-b9e6-1cee845faaab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:40.167556 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1387/2784] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:19:39 2022] DELETE /identity/v3/projects/419aeaadadd04744bf0e92580d06252b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:40.174874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679272-2dad-4bf9-bbfa-bb89429165be None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:40.175314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679272-2dad-4bf9-bbfa-bb89429165be None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:40.175776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679272-2dad-4bf9-bbfa-bb89429165be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:40.234910 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-31679272-2dad-4bf9-bbfa-bb89429165be None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:40.236954 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-31679272-2dad-4bf9-bbfa-bb89429165be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:40.292675 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:40.384907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1398/2785] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:40.386074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad26af4-9c30-4b9b-9857-422a6d71bfc1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:40.386367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad26af4-9c30-4b9b-9857-422a6d71bfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:40.386630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad26af4-9c30-4b9b-9857-422a6d71bfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:40.410736 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0ad26af4-9c30-4b9b-9857-422a6d71bfc1 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:40.412772 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0ad26af4-9c30-4b9b-9857-422a6d71bfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:40.424025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1388/2786] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:19:40.428714 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31679272-2dad-4bf9-bbfa-bb89429165be None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:40.440509 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31679272-2dad-4bf9-bbfa-bb89429165be None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:40.445544 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d62a69-1ddf-435e-bd76-f19d13b0032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:40.446299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d62a69-1ddf-435e-bd76-f19d13b0032a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:40.446701 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d62a69-1ddf-435e-bd76-f19d13b0032a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:40.447091 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d62a69-1ddf-435e-bd76-f19d13b0032a admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:40.447874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d62a69-1ddf-435e-bd76-f19d13b0032a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:19:40.448309 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d62a69-1ddf-435e-bd76-f19d13b0032a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:40.451056 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d62a69-1ddf-435e-bd76-f19d13b0032a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:40.471345 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1399/2787] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:19:40.476236 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad26af4-9c30-4b9b-9857-422a6d71bfc1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:40.487421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad26af4-9c30-4b9b-9857-422a6d71bfc1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:40.492983 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987a34c-1e65-4713-88db-102b4b501b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:40.493773 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a34c-1e65-4713-88db-102b4b501b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:40.493976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a34c-1e65-4713-88db-102b4b501b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:40.494246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a34c-1e65-4713-88db-102b4b501b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:40.495274 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987a34c-1e65-4713-88db-102b4b501b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:40.496805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987a34c-1e65-4713-88db-102b4b501b9a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:40.531666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1389/2788] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:19:40 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:40.538143 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d62a69-1ddf-435e-bd76-f19d13b0032a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:40.553238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d62a69-1ddf-435e-bd76-f19d13b0032a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:40.624946 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf751a6-bf8d-4a85-979c-dba64081e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:40.625760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf751a6-bf8d-4a85-979c-dba64081e924 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:40.625760 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf751a6-bf8d-4a85-979c-dba64081e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:40.626010 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf751a6-bf8d-4a85-979c-dba64081e924 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:40.626825 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf751a6-bf8d-4a85-979c-dba64081e924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:40.629055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf751a6-bf8d-4a85-979c-dba64081e924 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:40.657980 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1400/2789] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:19:40 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:40.664026 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987a34c-1e65-4713-88db-102b4b501b9a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:40.683076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987a34c-1e65-4713-88db-102b4b501b9a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:40.690216 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6523aba-3294-498f-b981-2312920ab71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:40.690875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6523aba-3294-498f-b981-2312920ab71f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:40.691153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6523aba-3294-498f-b981-2312920ab71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:40.691463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6523aba-3294-498f-b981-2312920ab71f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:40.692467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6523aba-3294-498f-b981-2312920ab71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:40.694940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6523aba-3294-498f-b981-2312920ab71f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:40.716391 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1390/2790] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:19:40.717910 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf751a6-bf8d-4a85-979c-dba64081e924 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:40.729199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf751a6-bf8d-4a85-979c-dba64081e924 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:40.735357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190ff38-527c-43ef-a039-8a3416f2bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:40.736536 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ff38-527c-43ef-a039-8a3416f2bfdb admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:40.736703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ff38-527c-43ef-a039-8a3416f2bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:40.736869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ff38-527c-43ef-a039-8a3416f2bfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:40.737684 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190ff38-527c-43ef-a039-8a3416f2bfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:40.739419 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190ff38-527c-43ef-a039-8a3416f2bfdb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:40.760199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1401/2791] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:40.764050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6523aba-3294-498f-b981-2312920ab71f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:40.774938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6523aba-3294-498f-b981-2312920ab71f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:40.781605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e084d24-6ca1-4d1a-a7e0-d854dd59e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:40.782373 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e084d24-6ca1-4d1a-a7e0-d854dd59e1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:40.782789 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e084d24-6ca1-4d1a-a7e0-d854dd59e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:40.783272 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e084d24-6ca1-4d1a-a7e0-d854dd59e1f6 admin admin] PATH_INFO: `/v3/projects/c116489c13f140638ef1ac14ae90ded5/users/a0eee671f4414dc1a52da0bfb7c1146f/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:40.802496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e084d24-6ca1-4d1a-a7e0-d854dd59e1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c116489c13f140638ef1ac14ae90ded5, user_id=a0eee671f4414dc1a52da0bfb7c1146f, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:40.805219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e084d24-6ca1-4d1a-a7e0-d854dd59e1f6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:40.821847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1391/2792] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:40 2022] PUT /identity/v3/projects/c116489c13f140638ef1ac14ae90ded5/users/a0eee671f4414dc1a52da0bfb7c1146f/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:40.833705 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195814f-1067-4cfa-9659-918788baf62e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:40.833996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195814f-1067-4cfa-9659-918788baf62e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:40.834278 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195814f-1067-4cfa-9659-918788baf62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:40.865299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e195814f-1067-4cfa-9659-918788baf62e None None] MFA Rules not processed for user `a0eee671f4414dc1a52da0bfb7c1146f`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:40.866545 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e195814f-1067-4cfa-9659-918788baf62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:40.946617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1402/2793] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:40.955833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e084d24-6ca1-4d1a-a7e0-d854dd59e1f6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:41.025114 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e084d24-6ca1-4d1a-a7e0-d854dd59e1f6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:41.031754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f7038-6690-4ccd-bd62-2b70f029aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:41.032354 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7038-6690-4ccd-bd62-2b70f029aef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:41.032672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7038-6690-4ccd-bd62-2b70f029aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:41.032927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7038-6690-4ccd-bd62-2b70f029aef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:41.033564 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f7038-6690-4ccd-bd62-2b70f029aef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:41.035503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f7038-6690-4ccd-bd62-2b70f029aef6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:41.063946 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1392/2794] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:19:40 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:41.068226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195814f-1067-4cfa-9659-918788baf62e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:41.082136 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195814f-1067-4cfa-9659-918788baf62e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:41.116650 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:41.167329 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d818d63-bab2-4a5b-b8a9-5a3375c8d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:41.170750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818d63-bab2-4a5b-b8a9-5a3375c8d5bb admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:41.170750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818d63-bab2-4a5b-b8a9-5a3375c8d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:41.170750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818d63-bab2-4a5b-b8a9-5a3375c8d5bb admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:41.170750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d818d63-bab2-4a5b-b8a9-5a3375c8d5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:41.174423 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d818d63-bab2-4a5b-b8a9-5a3375c8d5bb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:41.202740 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1403/2795] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:19:41 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:41.205279 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f7038-6690-4ccd-bd62-2b70f029aef6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:41.217808 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f7038-6690-4ccd-bd62-2b70f029aef6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:41.225433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df72ae6-9ced-4b0d-9244-8f5cf1b4200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:41.226057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df72ae6-9ced-4b0d-9244-8f5cf1b4200a admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:41.226342 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df72ae6-9ced-4b0d-9244-8f5cf1b4200a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:41.226620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df72ae6-9ced-4b0d-9244-8f5cf1b4200a admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:41.227271 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df72ae6-9ced-4b0d-9244-8f5cf1b4200a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:41.228910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df72ae6-9ced-4b0d-9244-8f5cf1b4200a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:41.230492 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:41.251123 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1393/2796] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:19:41.252585 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d818d63-bab2-4a5b-b8a9-5a3375c8d5bb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:41.267531 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d818d63-bab2-4a5b-b8a9-5a3375c8d5bb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:41.274918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a93658-113d-4199-8b1f-143c334b1785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:41.276168 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93658-113d-4199-8b1f-143c334b1785 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:41.276618 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93658-113d-4199-8b1f-143c334b1785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:41.277105 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93658-113d-4199-8b1f-143c334b1785 admin admin] PATH_INFO: `/v3/projects/53429251d970462184ce940a53bd7aa6/users/17e1814ba9094a8bbdcbf0a11882ce95/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:41.301853 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a93658-113d-4199-8b1f-143c334b1785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53429251d970462184ce940a53bd7aa6, user_id=17e1814ba9094a8bbdcbf0a11882ce95, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:41.305750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a93658-113d-4199-8b1f-143c334b1785 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:41.326237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1404/2797] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:41 2022] PUT /identity/v3/projects/53429251d970462184ce940a53bd7aa6/users/17e1814ba9094a8bbdcbf0a11882ce95/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:41.332046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df72ae6-9ced-4b0d-9244-8f5cf1b4200a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:41.343182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df72ae6-9ced-4b0d-9244-8f5cf1b4200a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:41.443225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400a992-b8a7-4745-9a65-2d07e31ea43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:41.443886 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400a992-b8a7-4745-9a65-2d07e31ea43c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:41.444173 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400a992-b8a7-4745-9a65-2d07e31ea43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:41.444762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400a992-b8a7-4745-9a65-2d07e31ea43c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:41.445662 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400a992-b8a7-4745-9a65-2d07e31ea43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:41.447403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400a992-b8a7-4745-9a65-2d07e31ea43c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:41.460546 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1394/2798] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:41.465422 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a93658-113d-4199-8b1f-143c334b1785 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:41.479061 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a93658-113d-4199-8b1f-143c334b1785 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:41.485669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0786-bdd2-4c29-86b9-eedd3aaa3cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:41.486528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0786-bdd2-4c29-86b9-eedd3aaa3cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:41.486878 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0786-bdd2-4c29-86b9-eedd3aaa3cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:41.487294 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0786-bdd2-4c29-86b9-eedd3aaa3cc3 admin admin] PATH_INFO: `/v3/projects/53429251d970462184ce940a53bd7aa6/users/17e1814ba9094a8bbdcbf0a11882ce95/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:41.489927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0786-bdd2-4c29-86b9-eedd3aaa3cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53429251d970462184ce940a53bd7aa6, user_id=17e1814ba9094a8bbdcbf0a11882ce95, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:41.493404 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0786-bdd2-4c29-86b9-eedd3aaa3cc3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:41.509167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1405/2799] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:41 2022] PUT /identity/v3/projects/53429251d970462184ce940a53bd7aa6/users/17e1814ba9094a8bbdcbf0a11882ce95/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:41.521627 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59536b56-ce98-4c1c-b882-6fdb7d3a5f52 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:41.522028 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59536b56-ce98-4c1c-b882-6fdb7d3a5f52 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:41.522417 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59536b56-ce98-4c1c-b882-6fdb7d3a5f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:41.553709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-59536b56-ce98-4c1c-b882-6fdb7d3a5f52 None None] MFA Rules not processed for user `17e1814ba9094a8bbdcbf0a11882ce95`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:41.555089 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-59536b56-ce98-4c1c-b882-6fdb7d3a5f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:41.634112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1395/2800] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:41.647700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0786-bdd2-4c29-86b9-eedd3aaa3cc3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:41.649952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-799b0786-bdd2-4c29-86b9-eedd3aaa3cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:41.722942 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0786-bdd2-4c29-86b9-eedd3aaa3cc3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:41.729067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cd2fd-ac37-4181-a084-e876bb0ac178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:41.730232 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cd2fd-ac37-4181-a084-e876bb0ac178 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:41.730530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cd2fd-ac37-4181-a084-e876bb0ac178 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:41.730939 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cd2fd-ac37-4181-a084-e876bb0ac178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:41.747139 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cd2fd-ac37-4181-a084-e876bb0ac178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:41.749377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cd2fd-ac37-4181-a084-e876bb0ac178 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:41.768677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1406/2801] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:19:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:19:41.856065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59536b56-ce98-4c1c-b882-6fdb7d3a5f52 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:41.869131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59536b56-ce98-4c1c-b882-6fdb7d3a5f52 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:41.874120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9fe0-6b60-49ef-a7a4-5c8dc0367c72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:41.874775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9fe0-6b60-49ef-a7a4-5c8dc0367c72 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:41.875112 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9fe0-6b60-49ef-a7a4-5c8dc0367c72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:41.875591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9fe0-6b60-49ef-a7a4-5c8dc0367c72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:41.943287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9fe0-6b60-49ef-a7a4-5c8dc0367c72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:41.945619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9fe0-6b60-49ef-a7a4-5c8dc0367c72 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:41.960224 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1396/2802] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:19:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:19:47.624609 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe8f65-dc21-420c-b6ce-0b0af53e0bf3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:47.625110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe8f65-dc21-420c-b6ce-0b0af53e0bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:47.625208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe8f65-dc21-420c-b6ce-0b0af53e0bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:47.643937 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-89fe8f65-dc21-420c-b6ce-0b0af53e0bf3 None None] MFA Rules not processed for user `4f7bdd26be524f6e8354e6fbdcd50136`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:47.645144 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-89fe8f65-dc21-420c-b6ce-0b0af53e0bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:47.698662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1407/2803] 10.222.0.83 () {58 vars in 967 bytes} [Wed Aug 31 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:47.711524 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9fe0-6b60-49ef-a7a4-5c8dc0367c72 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:47.712920 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c47f9fe0-6b60-49ef-a7a4-5c8dc0367c72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:47.731419 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:47.783012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9fe0-6b60-49ef-a7a4-5c8dc0367c72 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:47.787863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba3e64-7149-44ae-911c-f7e57c415736 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814473b735314e4cb2321e952777031c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:47.788520 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3e64-7149-44ae-911c-f7e57c415736 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:47.788802 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3e64-7149-44ae-911c-f7e57c415736 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:47.789077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3e64-7149-44ae-911c-f7e57c415736 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:47.797029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba3e64-7149-44ae-911c-f7e57c415736 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:47.798625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba3e64-7149-44ae-911c-f7e57c415736 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:47.806525 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1397/2804] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Aug 31 01:19:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 01:19:48.438556 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe8f65-dc21-420c-b6ce-0b0af53e0bf3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:48.471462 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:48.503826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe8f65-dc21-420c-b6ce-0b0af53e0bf3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:48.508449 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:48.509082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:48.509365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:48.509651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] PATH_INFO: `/v3/users/a0eee671f4414dc1a52da0bfb7c1146f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:48.510787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0eee671f4414dc1a52da0bfb7c1146f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:48.512894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:48.560196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0eee671f4414dc1a52da0bfb7c1146f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:48.560869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0eee671f4414dc1a52da0bfb7c1146f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:48.568009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0eee671f4414dc1a52da0bfb7c1146f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:48.575546 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0eee671f4414dc1a52da0bfb7c1146f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:48.587413 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0eee671f4414dc1a52da0bfb7c1146f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:48.593761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1408/2805] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:19:48 2022] DELETE /identity/v3/users/a0eee671f4414dc1a52da0bfb7c1146f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:48.598348 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b8a8-408b-41fb-bbe6-0d0b0e342681 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:48.598656 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b8a8-408b-41fb-bbe6-0d0b0e342681 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:48.598933 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b8a8-408b-41fb-bbe6-0d0b0e342681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:48.620472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5068b8a8-408b-41fb-bbe6-0d0b0e342681 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:48.621673 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5068b8a8-408b-41fb-bbe6-0d0b0e342681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:48.680338 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1398/2806] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:48.690106 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:48.691644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:48.748383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ca54e-35a3-4ac2-b3d2-62590c369573 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:48.751988 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15816-6169-49a7-aa8e-a4ac194479fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:48.752617 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15816-6169-49a7-aa8e-a4ac194479fa service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:48.752899 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15816-6169-49a7-aa8e-a4ac194479fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:48.753173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15816-6169-49a7-aa8e-a4ac194479fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:48.762111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d15816-6169-49a7-aa8e-a4ac194479fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:48.763532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d15816-6169-49a7-aa8e-a4ac194479fa service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:48.772861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1409/2807] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:19:49.042999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068b8a8-408b-41fb-bbe6-0d0b0e342681 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:49.045030 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5068b8a8-408b-41fb-bbe6-0d0b0e342681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:49.057091 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068b8a8-408b-41fb-bbe6-0d0b0e342681 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:49.062288 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:49.062921 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:49.063200 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:49.063472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] PATH_INFO: `/v3/projects/c116489c13f140638ef1ac14ae90ded5` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:49.064849 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c116489c13f140638ef1ac14ae90ded5)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:49.066776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:49.114126 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c116489c13f140638ef1ac14ae90ded5', 'request_id': 'req-cdfd5026-0022-48df-8ab4-efc8f66f0110'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.119410 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c116489c13f140638ef1ac14ae90ded5', 'request_id': 'req-cdfd5026-0022-48df-8ab4-efc8f66f0110'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.128498 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c116489c13f140638ef1ac14ae90ded5', 'request_id': 'req-cdfd5026-0022-48df-8ab4-efc8f66f0110'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.141381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] The token cache is being invalidate because project c116489c13f140638ef1ac14ae90ded5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:19:49.141678 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.142334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.144008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1399/2808] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:19:49 2022] DELETE /identity/v3/projects/c116489c13f140638ef1ac14ae90ded5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:49.148040 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15816-6169-49a7-aa8e-a4ac194479fa service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:49.159068 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15816-6169-49a7-aa8e-a4ac194479fa service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:49.208888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:49.220178 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:49.220872 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:49.221383 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:49.221891 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] PATH_INFO: `/v3/users/17e1814ba9094a8bbdcbf0a11882ce95` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:49.223213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e1814ba9094a8bbdcbf0a11882ce95)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:49.225387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:49.275589 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e1814ba9094a8bbdcbf0a11882ce95'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.276249 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e1814ba9094a8bbdcbf0a11882ce95'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.285426 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e1814ba9094a8bbdcbf0a11882ce95'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.293357 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e1814ba9094a8bbdcbf0a11882ce95'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.306053 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e1814ba9094a8bbdcbf0a11882ce95'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.313771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1410/2809] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:19:49 2022] DELETE /identity/v3/users/17e1814ba9094a8bbdcbf0a11882ce95 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:49.593068 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:49.594981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:49.622671 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd5026-0022-48df-8ab4-efc8f66f0110 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:49.650658 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:49.696884 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:49.697575 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:49.697906 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:49.698225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] PATH_INFO: `/v3/projects/53429251d970462184ce940a53bd7aa6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:49.699379 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53429251d970462184ce940a53bd7aa6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:49.701882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:49.752615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:49.754179 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:49.767081 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53429251d970462184ce940a53bd7aa6', 'request_id': 'req-421d8298-776e-4d6f-859d-f0f75b782de4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.772003 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe76230-6163-4ea4-929f-7f24359cfe2b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:49.773217 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53429251d970462184ce940a53bd7aa6', 'request_id': 'req-421d8298-776e-4d6f-859d-f0f75b782de4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.784822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53429251d970462184ce940a53bd7aa6', 'request_id': 'req-421d8298-776e-4d6f-859d-f0f75b782de4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.796953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] The token cache is being invalidate because project 53429251d970462184ce940a53bd7aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:19:49.797245 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.797883 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-421d8298-776e-4d6f-859d-f0f75b782de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.799404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1400/2810] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:19:49 2022] DELETE /identity/v3/projects/53429251d970462184ce940a53bd7aa6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:49.804127 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5d6ae-3315-4b72-88f8-82ada2af0c04 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:49.804444 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5d6ae-3315-4b72-88f8-82ada2af0c04 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:49.804718 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5d6ae-3315-4b72-88f8-82ada2af0c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:49.824699 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-70b5d6ae-3315-4b72-88f8-82ada2af0c04 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:49.826507 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-70b5d6ae-3315-4b72-88f8-82ada2af0c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:49.837288 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:49.837929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:49.838204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:49.838533 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] PATH_INFO: `/v3/users/fee8df3f7c084a92803d0a6f87f50afb` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:49.839716 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee8df3f7c084a92803d0a6f87f50afb)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:49.841888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:49.888374 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1401/2811] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:19:49.891907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee8df3f7c084a92803d0a6f87f50afb'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.892586 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee8df3f7c084a92803d0a6f87f50afb'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.896650 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8690a-a968-4c73-b90d-6246cb245caf None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:49.896943 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8690a-a968-4c73-b90d-6246cb245caf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:49.897218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8690a-a968-4c73-b90d-6246cb245caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:49.900347 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee8df3f7c084a92803d0a6f87f50afb'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.908209 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee8df3f7c084a92803d0a6f87f50afb'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.916049 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:49.917020 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c3a8690a-a968-4c73-b90d-6246cb245caf None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:49.918118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c3a8690a-a968-4c73-b90d-6246cb245caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:49.922696 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee8df3f7c084a92803d0a6f87f50afb'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:49.927246 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1402/2812] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:19:49.929914 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1411/2813] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:19:49 2022] DELETE /identity/v3/users/fee8df3f7c084a92803d0a6f87f50afb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:19:49.931522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8690a-a968-4c73-b90d-6246cb245caf None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:49.941652 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8690a-a968-4c73-b90d-6246cb245caf None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:49.996739 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:50.007125 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191df9aa-64d0-4809-bb9b-0d4caec67e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.008249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191df9aa-64d0-4809-bb9b-0d4caec67e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.008558 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191df9aa-64d0-4809-bb9b-0d4caec67e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.008833 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191df9aa-64d0-4809-bb9b-0d4caec67e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.009490 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191df9aa-64d0-4809-bb9b-0d4caec67e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:19:50.010108 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191df9aa-64d0-4809-bb9b-0d4caec67e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.012029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191df9aa-64d0-4809-bb9b-0d4caec67e97 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.024504 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1403/2814] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:19:50.029526 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.039910 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c476fa8-a5f2-40ee-a07a-a23f3d32315c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.045394 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf88d-451d-4a52-b78a-f66cd10d3444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.046065 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf88d-451d-4a52-b78a-f66cd10d3444 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.046356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf88d-451d-4a52-b78a-f66cd10d3444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.046632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf88d-451d-4a52-b78a-f66cd10d3444 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.047302 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bf88d-451d-4a52-b78a-f66cd10d3444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.049425 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bf88d-451d-4a52-b78a-f66cd10d3444 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.078470 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1412/2815] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:19:50 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:19:50.082776 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191df9aa-64d0-4809-bb9b-0d4caec67e97 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.093945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191df9aa-64d0-4809-bb9b-0d4caec67e97 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.109341 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf88d-451d-4a52-b78a-f66cd10d3444 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.111126 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-031bf88d-451d-4a52-b78a-f66cd10d3444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:50.167225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086d1c5-ef66-4cbf-9424-38eab9ba88cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.167755 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086d1c5-ef66-4cbf-9424-38eab9ba88cd admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.168040 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086d1c5-ef66-4cbf-9424-38eab9ba88cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.168313 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086d1c5-ef66-4cbf-9424-38eab9ba88cd admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.169126 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086d1c5-ef66-4cbf-9424-38eab9ba88cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.171061 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086d1c5-ef66-4cbf-9424-38eab9ba88cd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.185104 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf88d-451d-4a52-b78a-f66cd10d3444 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.191456 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.192109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.192457 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.193055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1404/2816] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:19:50 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:50.195869 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] PATH_INFO: `/v3/projects/07a4a857708240d3a61f7647c18a92fc` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.196646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086d1c5-ef66-4cbf-9424-38eab9ba88cd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.197154 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a4a857708240d3a61f7647c18a92fc)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.199079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.207054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086d1c5-ef66-4cbf-9424-38eab9ba88cd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.211782 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc6eaf-77b2-43a1-af82-24f6f9520b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.212403 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6eaf-77b2-43a1-af82-24f6f9520b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.212685 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6eaf-77b2-43a1-af82-24f6f9520b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.212971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6eaf-77b2-43a1-af82-24f6f9520b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.213600 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc6eaf-77b2-43a1-af82-24f6f9520b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.215167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc6eaf-77b2-43a1-af82-24f6f9520b9e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.227014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1405/2817] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:19:50.231334 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc6eaf-77b2-43a1-af82-24f6f9520b9e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.241253 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc6eaf-77b2-43a1-af82-24f6f9520b9e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.250382 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a4a857708240d3a61f7647c18a92fc', 'request_id': 'req-ec50dfd0-41fb-4244-83bb-184189488504'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:50.256633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a4a857708240d3a61f7647c18a92fc', 'request_id': 'req-ec50dfd0-41fb-4244-83bb-184189488504'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:50.264437 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a4a857708240d3a61f7647c18a92fc', 'request_id': 'req-ec50dfd0-41fb-4244-83bb-184189488504'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:50.277403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] The token cache is being invalidate because project 07a4a857708240d3a61f7647c18a92fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:19:50.277638 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:50.278358 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:50.279865 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1413/2818] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:19:50 2022] DELETE /identity/v3/projects/07a4a857708240d3a61f7647c18a92fc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:19:50.300705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936332d5-4208-47a9-97fe-c601d7dc3758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.301365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936332d5-4208-47a9-97fe-c601d7dc3758 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.301653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936332d5-4208-47a9-97fe-c601d7dc3758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.301935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936332d5-4208-47a9-97fe-c601d7dc3758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.302602 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936332d5-4208-47a9-97fe-c601d7dc3758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.304257 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936332d5-4208-47a9-97fe-c601d7dc3758 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.322554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1406/2819] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:50.327606 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.329074 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:50.343709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50dfd0-41fb-4244-83bb-184189488504 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.348700 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34ce49-3e1f-41b8-9f2b-5e833dc64f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.349436 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34ce49-3e1f-41b8-9f2b-5e833dc64f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.349724 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34ce49-3e1f-41b8-9f2b-5e833dc64f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.350005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34ce49-3e1f-41b8-9f2b-5e833dc64f4a admin admin] PATH_INFO: `/v3/projects/2b156e2dd24f476bba7637b6aaa0b4f9/users/f020a6aaa3844e8084512d308ca6830e/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.368167 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34ce49-3e1f-41b8-9f2b-5e833dc64f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b156e2dd24f476bba7637b6aaa0b4f9, user_id=f020a6aaa3844e8084512d308ca6830e, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.371005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34ce49-3e1f-41b8-9f2b-5e833dc64f4a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.386665 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1414/2820] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:50 2022] PUT /identity/v3/projects/2b156e2dd24f476bba7637b6aaa0b4f9/users/f020a6aaa3844e8084512d308ca6830e/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:50.398799 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bc92e-7a34-434b-ab45-b9d46714285f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.399077 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bc92e-7a34-434b-ab45-b9d46714285f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.399345 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bc92e-7a34-434b-ab45-b9d46714285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.430910 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b24bc92e-7a34-434b-ab45-b9d46714285f None None] MFA Rules not processed for user `f020a6aaa3844e8084512d308ca6830e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:50.432036 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b24bc92e-7a34-434b-ab45-b9d46714285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:50.487057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:50.506232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1407/2821] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:50.510893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34ce49-3e1f-41b8-9f2b-5e833dc64f4a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.553594 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:50.579090 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34ce49-3e1f-41b8-9f2b-5e833dc64f4a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.583874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdb5d3-a764-46db-8939-6b1d48745043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.584505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdb5d3-a764-46db-8939-6b1d48745043 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.584789 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdb5d3-a764-46db-8939-6b1d48745043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.585064 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdb5d3-a764-46db-8939-6b1d48745043 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.585699 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdb5d3-a764-46db-8939-6b1d48745043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.587905 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdb5d3-a764-46db-8939-6b1d48745043 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.614313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1415/2822] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:19:50 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:19:50.618370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bc92e-7a34-434b-ab45-b9d46714285f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.629370 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bc92e-7a34-434b-ab45-b9d46714285f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.685734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920260a5-6f79-43cd-aa9b-0b29cc0493ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.686244 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920260a5-6f79-43cd-aa9b-0b29cc0493ed admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.686526 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920260a5-6f79-43cd-aa9b-0b29cc0493ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.686805 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920260a5-6f79-43cd-aa9b-0b29cc0493ed admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.687427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920260a5-6f79-43cd-aa9b-0b29cc0493ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.690093 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920260a5-6f79-43cd-aa9b-0b29cc0493ed admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.710855 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1408/2823] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:19:50 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:50.715055 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdb5d3-a764-46db-8939-6b1d48745043 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.726073 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdb5d3-a764-46db-8939-6b1d48745043 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.730965 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac283c8a-315d-454a-83cb-bd05af16d188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.731757 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283c8a-315d-454a-83cb-bd05af16d188 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.732205 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283c8a-315d-454a-83cb-bd05af16d188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.732717 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283c8a-315d-454a-83cb-bd05af16d188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.733362 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac283c8a-315d-454a-83cb-bd05af16d188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.734941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac283c8a-315d-454a-83cb-bd05af16d188 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.745851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1416/2824] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:50.750143 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920260a5-6f79-43cd-aa9b-0b29cc0493ed admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.760170 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920260a5-6f79-43cd-aa9b-0b29cc0493ed admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.765416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99266e85-3c8b-4ffc-96ed-c49e58b65e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.766065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99266e85-3c8b-4ffc-96ed-c49e58b65e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.766349 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99266e85-3c8b-4ffc-96ed-c49e58b65e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.766630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99266e85-3c8b-4ffc-96ed-c49e58b65e03 admin admin] PATH_INFO: `/v3/projects/e086359971964c609ba5ba7de91cf800/users/fde3ab10a1e5403faa4900247a960e01/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.781953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99266e85-3c8b-4ffc-96ed-c49e58b65e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e086359971964c609ba5ba7de91cf800, user_id=fde3ab10a1e5403faa4900247a960e01, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.784618 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99266e85-3c8b-4ffc-96ed-c49e58b65e03 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.797269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1409/2825] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:50 2022] PUT /identity/v3/projects/e086359971964c609ba5ba7de91cf800/users/fde3ab10a1e5403faa4900247a960e01/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:50.801940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac283c8a-315d-454a-83cb-bd05af16d188 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.815299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac283c8a-315d-454a-83cb-bd05af16d188 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.870204 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fc5e8-d56c-4bad-b905-010a09bd427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.870805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fc5e8-d56c-4bad-b905-010a09bd427f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.871087 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fc5e8-d56c-4bad-b905-010a09bd427f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.871361 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fc5e8-d56c-4bad-b905-010a09bd427f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.872596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fc5e8-d56c-4bad-b905-010a09bd427f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.874175 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fc5e8-d56c-4bad-b905-010a09bd427f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.883742 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1417/2826] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:50.888579 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99266e85-3c8b-4ffc-96ed-c49e58b65e03 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:50.898836 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99266e85-3c8b-4ffc-96ed-c49e58b65e03 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:50.903534 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82df27-5570-4f43-823d-c38b81234747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:50.904243 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82df27-5570-4f43-823d-c38b81234747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.904554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82df27-5570-4f43-823d-c38b81234747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.904940 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82df27-5570-4f43-823d-c38b81234747 admin admin] PATH_INFO: `/v3/projects/e086359971964c609ba5ba7de91cf800/users/fde3ab10a1e5403faa4900247a960e01/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.906875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82df27-5570-4f43-823d-c38b81234747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e086359971964c609ba5ba7de91cf800, user_id=fde3ab10a1e5403faa4900247a960e01, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:50.909550 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82df27-5570-4f43-823d-c38b81234747 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:50.920570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1410/2827] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:50 2022] PUT /identity/v3/projects/e086359971964c609ba5ba7de91cf800/users/fde3ab10a1e5403faa4900247a960e01/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:50.930807 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35d95-3b97-4d13-8b19-c158b093c7c0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:50.931100 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35d95-3b97-4d13-8b19-c158b093c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:50.931386 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35d95-3b97-4d13-8b19-c158b093c7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:50.960138 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d5f35d95-3b97-4d13-8b19-c158b093c7c0 None None] MFA Rules not processed for user `fde3ab10a1e5403faa4900247a960e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:50.961348 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d5f35d95-3b97-4d13-8b19-c158b093c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:51.027709 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1418/2828] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:51.038990 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82df27-5570-4f43-823d-c38b81234747 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:51.040748 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4d82df27-5570-4f43-823d-c38b81234747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:51.097651 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82df27-5570-4f43-823d-c38b81234747 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:51.101277 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3f82-7e96-4452-a4f6-287256af96f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:51.101871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3f82-7e96-4452-a4f6-287256af96f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:51.102153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3f82-7e96-4452-a4f6-287256af96f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:51.102428 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3f82-7e96-4452-a4f6-287256af96f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:51.111414 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c3f82-7e96-4452-a4f6-287256af96f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:51.112863 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c3f82-7e96-4452-a4f6-287256af96f2 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:51.122708 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1411/2829] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:19:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:19:51.152539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35d95-3b97-4d13-8b19-c158b093c7c0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:51.187826 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:51.218623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35d95-3b97-4d13-8b19-c158b093c7c0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:51.223196 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:51.223832 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:51.224120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:51.224429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] PATH_INFO: `/v3/users/f020a6aaa3844e8084512d308ca6830e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:51.225583 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f020a6aaa3844e8084512d308ca6830e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:51.227522 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:51.274206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f020a6aaa3844e8084512d308ca6830e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.274866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f020a6aaa3844e8084512d308ca6830e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.282334 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f020a6aaa3844e8084512d308ca6830e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.289363 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f020a6aaa3844e8084512d308ca6830e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.301948 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f020a6aaa3844e8084512d308ca6830e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.307794 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1419/2830] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:19:51 2022] DELETE /identity/v3/users/f020a6aaa3844e8084512d308ca6830e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:51.313294 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483ac42-bf9a-4f1f-9587-f0fa7d54fdeb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:51.313653 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483ac42-bf9a-4f1f-9587-f0fa7d54fdeb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:51.313994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483ac42-bf9a-4f1f-9587-f0fa7d54fdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:51.333281 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1483ac42-bf9a-4f1f-9587-f0fa7d54fdeb None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:51.334491 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1483ac42-bf9a-4f1f-9587-f0fa7d54fdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:51.374787 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:51.394352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1412/2831] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:51.406231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:51.408655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:51.466648 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539038ca-105a-4631-b76d-8ff5f726c61c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:51.470414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427914d-8b23-4ec1-9033-8d67641183df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:51.470958 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427914d-8b23-4ec1-9033-8d67641183df service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:51.471246 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427914d-8b23-4ec1-9033-8d67641183df service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:51.471520 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427914d-8b23-4ec1-9033-8d67641183df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:51.480475 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427914d-8b23-4ec1-9033-8d67641183df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:51.482004 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427914d-8b23-4ec1-9033-8d67641183df service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:51.491375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1420/2832] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:19:51.760056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483ac42-bf9a-4f1f-9587-f0fa7d54fdeb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:51.761527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1483ac42-bf9a-4f1f-9587-f0fa7d54fdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:51.774994 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483ac42-bf9a-4f1f-9587-f0fa7d54fdeb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:51.780820 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:51.781669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:51.782196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:51.782570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] PATH_INFO: `/v3/projects/2b156e2dd24f476bba7637b6aaa0b4f9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:51.783878 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b156e2dd24f476bba7637b6aaa0b4f9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:51.786445 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:51.832151 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b156e2dd24f476bba7637b6aaa0b4f9', 'request_id': 'req-1b1cc73f-6133-4b03-a32a-29a87e954d2d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.837429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b156e2dd24f476bba7637b6aaa0b4f9', 'request_id': 'req-1b1cc73f-6133-4b03-a32a-29a87e954d2d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.845023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b156e2dd24f476bba7637b6aaa0b4f9', 'request_id': 'req-1b1cc73f-6133-4b03-a32a-29a87e954d2d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.855935 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] The token cache is being invalidate because project 2b156e2dd24f476bba7637b6aaa0b4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:19:51.856270 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.857630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.859097 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1413/2833] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:19:51 2022] DELETE /identity/v3/projects/2b156e2dd24f476bba7637b6aaa0b4f9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:51.863019 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427914d-8b23-4ec1-9033-8d67641183df service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:51.872880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427914d-8b23-4ec1-9033-8d67641183df service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:51.920530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:51.930857 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:51.931489 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:51.931771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:51.932046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] PATH_INFO: `/v3/users/fde3ab10a1e5403faa4900247a960e01` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:51.933208 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde3ab10a1e5403faa4900247a960e01)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:51.935349 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:51.981033 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde3ab10a1e5403faa4900247a960e01'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.981759 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde3ab10a1e5403faa4900247a960e01'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.988632 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde3ab10a1e5403faa4900247a960e01'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:51.995534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde3ab10a1e5403faa4900247a960e01'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:52.007425 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-73e388dc-81cf-406e-a96f-f50dd94ef9e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde3ab10a1e5403faa4900247a960e01'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:52.013987 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1421/2834] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:19:51 2022] DELETE /identity/v3/users/fde3ab10a1e5403faa4900247a960e01 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:52.537785 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:52.539303 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:52.552451 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cc73f-6133-4b03-a32a-29a87e954d2d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:52.609977 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:52.610609 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:52.610890 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:52.611163 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] PATH_INFO: `/v3/projects/e086359971964c609ba5ba7de91cf800` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:52.612266 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e086359971964c609ba5ba7de91cf800)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:52.614191 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:52.660654 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e086359971964c609ba5ba7de91cf800', 'request_id': 'req-467a917b-94d5-4929-a96c-7f29ce441624'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:52.666054 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e086359971964c609ba5ba7de91cf800', 'request_id': 'req-467a917b-94d5-4929-a96c-7f29ce441624'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:52.674290 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e086359971964c609ba5ba7de91cf800', 'request_id': 'req-467a917b-94d5-4929-a96c-7f29ce441624'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:52.682142 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:52.686700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] The token cache is being invalidate because project e086359971964c609ba5ba7de91cf800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:19:52.687366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:52.688157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-467a917b-94d5-4929-a96c-7f29ce441624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:52.690053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1414/2835] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:19:52 2022] DELETE /identity/v3/projects/e086359971964c609ba5ba7de91cf800 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:52.695059 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0127d-4231-4752-af53-1f94a216f63d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:52.695410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0127d-4231-4752-af53-1f94a216f63d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:52.695750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0127d-4231-4752-af53-1f94a216f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:52.717193 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1cc0127d-4231-4752-af53-1f94a216f63d None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:52.718550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1cc0127d-4231-4752-af53-1f94a216f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:52.779352 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1422/2836] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:52.786825 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8526f68-87ba-4cfc-b3ff-3e95c7ad070b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:52.787113 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8526f68-87ba-4cfc-b3ff-3e95c7ad070b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:52.787386 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8526f68-87ba-4cfc-b3ff-3e95c7ad070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:52.806691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a8526f68-87ba-4cfc-b3ff-3e95c7ad070b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:52.807902 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a8526f68-87ba-4cfc-b3ff-3e95c7ad070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:52.815796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1415/2837] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:52.819927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0127d-4231-4752-af53-1f94a216f63d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:52.830811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0127d-4231-4752-af53-1f94a216f63d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:52.835482 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79d046-1f7f-48e7-a0c7-0289ae986cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:52.836086 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79d046-1f7f-48e7-a0c7-0289ae986cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:52.836503 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79d046-1f7f-48e7-a0c7-0289ae986cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:52.836792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79d046-1f7f-48e7-a0c7-0289ae986cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:52.837446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79d046-1f7f-48e7-a0c7-0289ae986cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:19:52.837756 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79d046-1f7f-48e7-a0c7-0289ae986cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:52.839377 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79d046-1f7f-48e7-a0c7-0289ae986cfc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:52.851313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1423/2838] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:19:52.855503 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8526f68-87ba-4cfc-b3ff-3e95c7ad070b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:52.865325 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8526f68-87ba-4cfc-b3ff-3e95c7ad070b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:52.870742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559bf3-f48e-4ab5-ad8e-37a9e4702775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:52.871341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559bf3-f48e-4ab5-ad8e-37a9e4702775 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:52.871619 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559bf3-f48e-4ab5-ad8e-37a9e4702775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:52.871887 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559bf3-f48e-4ab5-ad8e-37a9e4702775 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:52.872762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11559bf3-f48e-4ab5-ad8e-37a9e4702775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:52.874746 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11559bf3-f48e-4ab5-ad8e-37a9e4702775 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:52.901075 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1416/2839] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:19:52 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:52.905955 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79d046-1f7f-48e7-a0c7-0289ae986cfc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:52.915929 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79d046-1f7f-48e7-a0c7-0289ae986cfc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:52.971323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f6021-2880-4359-8012-202dc8011164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:52.971918 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6021-2880-4359-8012-202dc8011164 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:52.972199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6021-2880-4359-8012-202dc8011164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:52.972502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6021-2880-4359-8012-202dc8011164 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:52.973135 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f6021-2880-4359-8012-202dc8011164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:52.975037 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f6021-2880-4359-8012-202dc8011164 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:52.982829 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:52.997031 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1424/2840] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:19:52 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:19:53.001346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559bf3-f48e-4ab5-ad8e-37a9e4702775 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.011566 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559bf3-f48e-4ab5-ad8e-37a9e4702775 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.016695 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413647b-e580-4c9f-b7c5-3c22d13f9836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.017300 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413647b-e580-4c9f-b7c5-3c22d13f9836 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.017573 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413647b-e580-4c9f-b7c5-3c22d13f9836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.017848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413647b-e580-4c9f-b7c5-3c22d13f9836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.018485 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413647b-e580-4c9f-b7c5-3c22d13f9836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.020064 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413647b-e580-4c9f-b7c5-3c22d13f9836 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.030368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1417/2841] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:53.034161 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f6021-2880-4359-8012-202dc8011164 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.044282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f6021-2880-4359-8012-202dc8011164 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.048896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850fb1e-4d83-45d5-a22a-aaf057b874e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.049486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850fb1e-4d83-45d5-a22a-aaf057b874e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.049772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850fb1e-4d83-45d5-a22a-aaf057b874e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.050046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850fb1e-4d83-45d5-a22a-aaf057b874e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.050682 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850fb1e-4d83-45d5-a22a-aaf057b874e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.052391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850fb1e-4d83-45d5-a22a-aaf057b874e1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.063461 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1425/2842] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 01:19:53.067357 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413647b-e580-4c9f-b7c5-3c22d13f9836 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.078059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413647b-e580-4c9f-b7c5-3c22d13f9836 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.082868 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9a28-c59a-412a-99ef-8e6583d66454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.083565 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9a28-c59a-412a-99ef-8e6583d66454 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.083845 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9a28-c59a-412a-99ef-8e6583d66454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.084118 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9a28-c59a-412a-99ef-8e6583d66454 admin admin] PATH_INFO: `/v3/projects/7e5e45eeed3840c2be1ae6255974ebbd/users/2a0dc73db71f4f02a10a45dcc53eae9e/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.098311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b9a28-c59a-412a-99ef-8e6583d66454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5e45eeed3840c2be1ae6255974ebbd, user_id=2a0dc73db71f4f02a10a45dcc53eae9e, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.100958 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b9a28-c59a-412a-99ef-8e6583d66454 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.114048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1418/2843] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:53 2022] PUT /identity/v3/projects/7e5e45eeed3840c2be1ae6255974ebbd/users/2a0dc73db71f4f02a10a45dcc53eae9e/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:53.126173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246fc71-2d1b-4c43-b70a-8eafe6d77c32 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.126483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246fc71-2d1b-4c43-b70a-8eafe6d77c32 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.126758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246fc71-2d1b-4c43-b70a-8eafe6d77c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.155063 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0246fc71-2d1b-4c43-b70a-8eafe6d77c32 None None] MFA Rules not processed for user `2a0dc73db71f4f02a10a45dcc53eae9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:53.156266 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0246fc71-2d1b-4c43-b70a-8eafe6d77c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:53.226276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1426/2844] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:53.230812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9a28-c59a-412a-99ef-8e6583d66454 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.297877 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9a28-c59a-412a-99ef-8e6583d66454 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.302525 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b210-8922-4c6d-a379-027f6ef2126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.303122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b210-8922-4c6d-a379-027f6ef2126a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.303402 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b210-8922-4c6d-a379-027f6ef2126a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.303675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b210-8922-4c6d-a379-027f6ef2126a admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.304289 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092b210-8922-4c6d-a379-027f6ef2126a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.306219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092b210-8922-4c6d-a379-027f6ef2126a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.333247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1419/2845] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:19:53 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:53.337530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246fc71-2d1b-4c43-b70a-8eafe6d77c32 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.349392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246fc71-2d1b-4c43-b70a-8eafe6d77c32 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.404430 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55def0c5-9554-4bd8-9bce-8021546c638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.405043 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55def0c5-9554-4bd8-9bce-8021546c638e admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.405324 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55def0c5-9554-4bd8-9bce-8021546c638e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.405598 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55def0c5-9554-4bd8-9bce-8021546c638e admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.406233 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55def0c5-9554-4bd8-9bce-8021546c638e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.408142 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55def0c5-9554-4bd8-9bce-8021546c638e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.429693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1427/2846] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:19:53 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:53.433808 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b210-8922-4c6d-a379-027f6ef2126a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.444837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b210-8922-4c6d-a379-027f6ef2126a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.449435 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681b295-828a-4684-b520-16e6e42e3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.450801 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681b295-828a-4684-b520-16e6e42e3663 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.451090 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681b295-828a-4684-b520-16e6e42e3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.451369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681b295-828a-4684-b520-16e6e42e3663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.452016 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681b295-828a-4684-b520-16e6e42e3663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.453670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681b295-828a-4684-b520-16e6e42e3663 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.464053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1420/2847] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:53.468517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55def0c5-9554-4bd8-9bce-8021546c638e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.478703 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55def0c5-9554-4bd8-9bce-8021546c638e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.483969 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbc7f4-8ce1-4b6e-915c-fa2e8208397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.484677 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbc7f4-8ce1-4b6e-915c-fa2e8208397f admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.484940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbc7f4-8ce1-4b6e-915c-fa2e8208397f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.485327 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbc7f4-8ce1-4b6e-915c-fa2e8208397f admin admin] PATH_INFO: `/v3/projects/89445ee8846e444f932d7115691bbcea/users/ce8df748f21c4dc7b884c894b4a230fc/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.500480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbc7f4-8ce1-4b6e-915c-fa2e8208397f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89445ee8846e444f932d7115691bbcea, user_id=ce8df748f21c4dc7b884c894b4a230fc, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.503129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbc7f4-8ce1-4b6e-915c-fa2e8208397f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.515715 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1428/2848] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:53 2022] PUT /identity/v3/projects/89445ee8846e444f932d7115691bbcea/users/ce8df748f21c4dc7b884c894b4a230fc/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:19:53.519655 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681b295-828a-4684-b520-16e6e42e3663 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.530182 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681b295-828a-4684-b520-16e6e42e3663 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.586250 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19d560-3ef1-4855-9e6e-7d5d5973e94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.586944 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19d560-3ef1-4855-9e6e-7d5d5973e94f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.587130 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19d560-3ef1-4855-9e6e-7d5d5973e94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.587407 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19d560-3ef1-4855-9e6e-7d5d5973e94f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.588046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19d560-3ef1-4855-9e6e-7d5d5973e94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.589664 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19d560-3ef1-4855-9e6e-7d5d5973e94f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.599456 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1421/2849] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:53.603580 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbc7f4-8ce1-4b6e-915c-fa2e8208397f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.614365 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbc7f4-8ce1-4b6e-915c-fa2e8208397f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.619231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544779-da85-4da3-9fb0-241ff41579a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.619889 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544779-da85-4da3-9fb0-241ff41579a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.620171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544779-da85-4da3-9fb0-241ff41579a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.620486 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544779-da85-4da3-9fb0-241ff41579a5 admin admin] PATH_INFO: `/v3/projects/89445ee8846e444f932d7115691bbcea/users/ce8df748f21c4dc7b884c894b4a230fc/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.623041 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7544779-da85-4da3-9fb0-241ff41579a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89445ee8846e444f932d7115691bbcea, user_id=ce8df748f21c4dc7b884c894b4a230fc, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.625750 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7544779-da85-4da3-9fb0-241ff41579a5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.635792 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1429/2850] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:53 2022] PUT /identity/v3/projects/89445ee8846e444f932d7115691bbcea/users/ce8df748f21c4dc7b884c894b4a230fc/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:53.645757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e180a-55bc-4fba-8918-257c840acf49 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.646074 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e180a-55bc-4fba-8918-257c840acf49 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.646369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e180a-55bc-4fba-8918-257c840acf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.659626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:53.674949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-db5e180a-55bc-4fba-8918-257c840acf49 None None] MFA Rules not processed for user `ce8df748f21c4dc7b884c894b4a230fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:53.676140 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-db5e180a-55bc-4fba-8918-257c840acf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:53.741672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1422/2851] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:53.753129 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544779-da85-4da3-9fb0-241ff41579a5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.754823 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f7544779-da85-4da3-9fb0-241ff41579a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:53.777150 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:53.815067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544779-da85-4da3-9fb0-241ff41579a5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.818785 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4e5b-22a7-4273-8641-67ed82ed303b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.819391 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4e5b-22a7-4273-8641-67ed82ed303b service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.819673 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4e5b-22a7-4273-8641-67ed82ed303b service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.820022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4e5b-22a7-4273-8641-67ed82ed303b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.829219 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4e5b-22a7-4273-8641-67ed82ed303b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.830644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4e5b-22a7-4273-8641-67ed82ed303b service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.840020 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1430/2852] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:19:53.887189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e180a-55bc-4fba-8918-257c840acf49 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:53.888707 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-db5e180a-55bc-4fba-8918-257c840acf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:53.900693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e180a-55bc-4fba-8918-257c840acf49 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:53.904826 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b6323-0a1f-4786-af90-4cc502bb7fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:53.905421 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b6323-0a1f-4786-af90-4cc502bb7fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:53.905700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b6323-0a1f-4786-af90-4cc502bb7fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:53.906002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b6323-0a1f-4786-af90-4cc502bb7fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:53.961041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b6323-0a1f-4786-af90-4cc502bb7fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:53.962472 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b6323-0a1f-4786-af90-4cc502bb7fb5 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:53.971599 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1423/2853] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:19:57.373836 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4e5b-22a7-4273-8641-67ed82ed303b service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:57.444448 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4e5b-22a7-4273-8641-67ed82ed303b service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:57.449171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:57.450591 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:57.450876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:57.451319 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] PATH_INFO: `/v3/users/2a0dc73db71f4f02a10a45dcc53eae9e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:57.452513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0dc73db71f4f02a10a45dcc53eae9e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:57.454564 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:57.515499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0dc73db71f4f02a10a45dcc53eae9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:57.516188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0dc73db71f4f02a10a45dcc53eae9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:57.524379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0dc73db71f4f02a10a45dcc53eae9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:57.532828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0dc73db71f4f02a10a45dcc53eae9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:57.545881 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0dc73db71f4f02a10a45dcc53eae9e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:57.553976 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1431/2854] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:19:57 2022] DELETE /identity/v3/users/2a0dc73db71f4f02a10a45dcc53eae9e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:57.558984 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46409f-32b4-48db-8d26-83e1e9cf8978 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:57.560151 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46409f-32b4-48db-8d26-83e1e9cf8978 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:57.560317 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46409f-32b4-48db-8d26-83e1e9cf8978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:57.585700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ad46409f-32b4-48db-8d26-83e1e9cf8978 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:57.586953 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ad46409f-32b4-48db-8d26-83e1e9cf8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:57.664001 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1424/2855] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:57.674894 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:57.676654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:57.735532 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:57.753035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fc6c4-af67-42c6-a822-3f8613724365 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:57.756860 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af25bfd-377e-47d0-a378-3835adf68954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:57.757484 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25bfd-377e-47d0-a378-3835adf68954 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:57.758123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25bfd-377e-47d0-a378-3835adf68954 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:57.758666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25bfd-377e-47d0-a378-3835adf68954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:57.772840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af25bfd-377e-47d0-a378-3835adf68954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:57.774563 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af25bfd-377e-47d0-a378-3835adf68954 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:57.786896 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1432/2856] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:19:58.129218 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46409f-32b4-48db-8d26-83e1e9cf8978 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:58.131057 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ad46409f-32b4-48db-8d26-83e1e9cf8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:58.145197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46409f-32b4-48db-8d26-83e1e9cf8978 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:58.150017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:58.150666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:58.151591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:58.151834 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] PATH_INFO: `/v3/projects/7e5e45eeed3840c2be1ae6255974ebbd` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:58.153080 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5e45eeed3840c2be1ae6255974ebbd)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:58.155254 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:58.193287 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:58.211505 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5e45eeed3840c2be1ae6255974ebbd', 'request_id': 'req-f799a7ea-6c53-4913-a00c-92cf545f604e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.217002 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5e45eeed3840c2be1ae6255974ebbd', 'request_id': 'req-f799a7ea-6c53-4913-a00c-92cf545f604e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.224865 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5e45eeed3840c2be1ae6255974ebbd', 'request_id': 'req-f799a7ea-6c53-4913-a00c-92cf545f604e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.237657 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] The token cache is being invalidate because project 7e5e45eeed3840c2be1ae6255974ebbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:19:58.237938 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.238588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.240121 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1425/2857] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:19:58 2022] DELETE /identity/v3/projects/7e5e45eeed3840c2be1ae6255974ebbd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:58.244057 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af25bfd-377e-47d0-a378-3835adf68954 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:58.254810 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af25bfd-377e-47d0-a378-3835adf68954 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:58.314199 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:58.314842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:58.315122 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:58.315396 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] PATH_INFO: `/v3/users/ce8df748f21c4dc7b884c894b4a230fc` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:58.316695 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8df748f21c4dc7b884c894b4a230fc)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:58.319577 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:58.374137 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8df748f21c4dc7b884c894b4a230fc'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.374797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8df748f21c4dc7b884c894b4a230fc'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.382441 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8df748f21c4dc7b884c894b4a230fc'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.393238 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8df748f21c4dc7b884c894b4a230fc'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.408874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-c3b249c6-2049-4140-b5f6-00492b2eb838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8df748f21c4dc7b884c894b4a230fc'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.415072 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1433/2858] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:19:58 2022] DELETE /identity/v3/users/ce8df748f21c4dc7b884c894b4a230fc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:58.731723 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:58.733932 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:58.754999 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799a7ea-6c53-4913-a00c-92cf545f604e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:58.824368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:58.826018 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:58.826392 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:58.826666 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] PATH_INFO: `/v3/projects/89445ee8846e444f932d7115691bbcea` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:58.827842 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89445ee8846e444f932d7115691bbcea)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:58.829775 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:58.880129 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89445ee8846e444f932d7115691bbcea', 'request_id': 'req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.886268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89445ee8846e444f932d7115691bbcea', 'request_id': 'req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.894006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89445ee8846e444f932d7115691bbcea', 'request_id': 'req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.907154 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] The token cache is being invalidate because project 89445ee8846e444f932d7115691bbcea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:19:58.907439 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.908082 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e80d22e7-7a5d-4a8c-a17b-c6b990719cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:19:58.909828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1426/2859] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:19:58 2022] DELETE /identity/v3/projects/89445ee8846e444f932d7115691bbcea => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:58.914731 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf419402-9b91-4463-a941-73e020e6df7c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:58.915145 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf419402-9b91-4463-a941-73e020e6df7c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:58.915435 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf419402-9b91-4463-a941-73e020e6df7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:58.938163 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-cf419402-9b91-4463-a941-73e020e6df7c None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:58.939400 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cf419402-9b91-4463-a941-73e020e6df7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:59.004342 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1434/2860] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:59.012232 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4e2e2-4703-490b-bc0c-afb4278a41ca None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.013128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4e2e2-4703-490b-bc0c-afb4278a41ca None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.013667 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4e2e2-4703-490b-bc0c-afb4278a41ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.033909 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-82a4e2e2-4703-490b-bc0c-afb4278a41ca None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:59.035046 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-82a4e2e2-4703-490b-bc0c-afb4278a41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:59.042981 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1427/2861] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:59.047392 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf419402-9b91-4463-a941-73e020e6df7c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.053547 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:59.057581 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf419402-9b91-4463-a941-73e020e6df7c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.064256 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ed68b-5197-4f82-a86a-b27d4ed164e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.065018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ed68b-5197-4f82-a86a-b27d4ed164e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.065354 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ed68b-5197-4f82-a86a-b27d4ed164e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.065782 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ed68b-5197-4f82-a86a-b27d4ed164e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.066439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ed68b-5197-4f82-a86a-b27d4ed164e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:19:59.066747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ed68b-5197-4f82-a86a-b27d4ed164e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.068466 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ed68b-5197-4f82-a86a-b27d4ed164e8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.081250 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1435/2862] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:19:59.087670 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4e2e2-4703-490b-bc0c-afb4278a41ca None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.099663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4e2e2-4703-490b-bc0c-afb4278a41ca None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.106779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc55bc-a397-4e14-8848-9f7235cf9a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.107533 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc55bc-a397-4e14-8848-9f7235cf9a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.108025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc55bc-a397-4e14-8848-9f7235cf9a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.108557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc55bc-a397-4e14-8848-9f7235cf9a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.109709 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc55bc-a397-4e14-8848-9f7235cf9a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.112496 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc55bc-a397-4e14-8848-9f7235cf9a9a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.141586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1428/2863] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:19:59 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:59.146379 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ed68b-5197-4f82-a86a-b27d4ed164e8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.157861 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ed68b-5197-4f82-a86a-b27d4ed164e8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.227263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e454b88-a306-4c32-bda4-f508af0dc403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.227880 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e454b88-a306-4c32-bda4-f508af0dc403 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.228162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e454b88-a306-4c32-bda4-f508af0dc403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.228477 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e454b88-a306-4c32-bda4-f508af0dc403 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.229109 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e454b88-a306-4c32-bda4-f508af0dc403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.231035 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e454b88-a306-4c32-bda4-f508af0dc403 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.257170 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1436/2864] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:19:59 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:59.261567 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc55bc-a397-4e14-8848-9f7235cf9a9a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.275295 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc55bc-a397-4e14-8848-9f7235cf9a9a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.280807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a59c-d675-4ffb-b58a-c2e5ea936326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.282197 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a59c-d675-4ffb-b58a-c2e5ea936326 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.282481 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a59c-d675-4ffb-b58a-c2e5ea936326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.282759 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a59c-d675-4ffb-b58a-c2e5ea936326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.283406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47a59c-d675-4ffb-b58a-c2e5ea936326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.285081 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47a59c-d675-4ffb-b58a-c2e5ea936326 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.297196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1429/2865] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:59.301535 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e454b88-a306-4c32-bda4-f508af0dc403 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.313483 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e454b88-a306-4c32-bda4-f508af0dc403 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.319085 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d73d6a-7aa0-4918-9a82-1c8ce52e4b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.319702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d73d6a-7aa0-4918-9a82-1c8ce52e4b40 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.320005 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d73d6a-7aa0-4918-9a82-1c8ce52e4b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.320269 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d73d6a-7aa0-4918-9a82-1c8ce52e4b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.320953 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d73d6a-7aa0-4918-9a82-1c8ce52e4b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.322562 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d73d6a-7aa0-4918-9a82-1c8ce52e4b40 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.336410 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1437/2866] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:59.341361 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a59c-d675-4ffb-b58a-c2e5ea936326 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.351135 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:59.358014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a59c-d675-4ffb-b58a-c2e5ea936326 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.366175 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6223d95-e2fb-4c56-b9d8-ed735d2685ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.367138 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6223d95-e2fb-4c56-b9d8-ed735d2685ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.367592 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6223d95-e2fb-4c56-b9d8-ed735d2685ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.367875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6223d95-e2fb-4c56-b9d8-ed735d2685ef admin admin] PATH_INFO: `/v3/projects/3fcbc5e7b7994667b8801f6abad6b4f2/users/97959908e7b94c34869ce18af7795347/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.383369 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6223d95-e2fb-4c56-b9d8-ed735d2685ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcbc5e7b7994667b8801f6abad6b4f2, user_id=97959908e7b94c34869ce18af7795347, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.386116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6223d95-e2fb-4c56-b9d8-ed735d2685ef admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.400663 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1430/2867] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:59 2022] PUT /identity/v3/projects/3fcbc5e7b7994667b8801f6abad6b4f2/users/97959908e7b94c34869ce18af7795347/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:19:59.469755 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd37c84-1af1-4c2d-b854-20e686e1765d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.470328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd37c84-1af1-4c2d-b854-20e686e1765d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.470328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd37c84-1af1-4c2d-b854-20e686e1765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.500162 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ccd37c84-1af1-4c2d-b854-20e686e1765d None None] MFA Rules not processed for user `97959908e7b94c34869ce18af7795347`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:59.501414 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ccd37c84-1af1-4c2d-b854-20e686e1765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:59.566612 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1438/2868] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:59.571019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6223d95-e2fb-4c56-b9d8-ed735d2685ef admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.631356 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6223d95-e2fb-4c56-b9d8-ed735d2685ef admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.636022 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753379f-e2c7-4797-90e1-851fa17eb571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.636649 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753379f-e2c7-4797-90e1-851fa17eb571 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.636934 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753379f-e2c7-4797-90e1-851fa17eb571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.637206 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753379f-e2c7-4797-90e1-851fa17eb571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.638367 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753379f-e2c7-4797-90e1-851fa17eb571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.640247 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753379f-e2c7-4797-90e1-851fa17eb571 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.666221 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1431/2869] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:19:59 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:59.670694 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd37c84-1af1-4c2d-b854-20e686e1765d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.681322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd37c84-1af1-4c2d-b854-20e686e1765d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.740964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78689-96e3-437c-a0b2-087cefb0b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.741566 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78689-96e3-437c-a0b2-087cefb0b077 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.741848 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78689-96e3-437c-a0b2-087cefb0b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.742124 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78689-96e3-437c-a0b2-087cefb0b077 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.742761 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78689-96e3-437c-a0b2-087cefb0b077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.744702 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78689-96e3-437c-a0b2-087cefb0b077 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.753710 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:19:59.768727 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1439/2870] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:19:59 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:19:59.772701 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753379f-e2c7-4797-90e1-851fa17eb571 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.783828 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753379f-e2c7-4797-90e1-851fa17eb571 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.788442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b5d90-8971-481c-8ace-79a24e759a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.789065 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b5d90-8971-481c-8ace-79a24e759a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.789346 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b5d90-8971-481c-8ace-79a24e759a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.789614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b5d90-8971-481c-8ace-79a24e759a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.790248 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b5d90-8971-481c-8ace-79a24e759a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.791870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b5d90-8971-481c-8ace-79a24e759a64 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.802458 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1432/2871] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:59.806433 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78689-96e3-437c-a0b2-087cefb0b077 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.817147 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78689-96e3-437c-a0b2-087cefb0b077 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.821975 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda059be-b0a2-4b58-9ea3-c12571f3e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.822561 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda059be-b0a2-4b58-9ea3-c12571f3e243 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.822838 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda059be-b0a2-4b58-9ea3-c12571f3e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.823111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda059be-b0a2-4b58-9ea3-c12571f3e243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.823746 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda059be-b0a2-4b58-9ea3-c12571f3e243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.826259 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda059be-b0a2-4b58-9ea3-c12571f3e243 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.835983 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1440/2872] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:19:59.839871 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b5d90-8971-481c-8ace-79a24e759a64 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:19:59.849557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b5d90-8971-481c-8ace-79a24e759a64 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:19:59.854240 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c154-6999-49bb-a396-1f5a689a0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:19:59.854904 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c154-6999-49bb-a396-1f5a689a0d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.855188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c154-6999-49bb-a396-1f5a689a0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.855467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c154-6999-49bb-a396-1f5a689a0d48 admin admin] PATH_INFO: `/v3/projects/5c8cf168fc9846c3b3e59df500b5994d/users/336186686c1249b5bb4880355f946ca5/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.870102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c154-6999-49bb-a396-1f5a689a0d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c8cf168fc9846c3b3e59df500b5994d, user_id=336186686c1249b5bb4880355f946ca5, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:19:59.873675 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c154-6999-49bb-a396-1f5a689a0d48 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:19:59.886629 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1433/2873] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:19:59 2022] PUT /identity/v3/projects/5c8cf168fc9846c3b3e59df500b5994d/users/336186686c1249b5bb4880355f946ca5/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:19:59.897513 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f567b72-ece3-4ce2-8033-e091e6a57804 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:19:59.897802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f567b72-ece3-4ce2-8033-e091e6a57804 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:19:59.898079 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f567b72-ece3-4ce2-8033-e091e6a57804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:19:59.925254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0f567b72-ece3-4ce2-8033-e091e6a57804 None None] MFA Rules not processed for user `336186686c1249b5bb4880355f946ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:19:59.926458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0f567b72-ece3-4ce2-8033-e091e6a57804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:19:59.989713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1441/2874] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:19:59.994167 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c154-6999-49bb-a396-1f5a689a0d48 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:00.054527 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c154-6999-49bb-a396-1f5a689a0d48 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:00.059703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a808ced-1fb3-448b-ba17-4ed75b8278f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:00.060406 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808ced-1fb3-448b-ba17-4ed75b8278f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:00.060696 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808ced-1fb3-448b-ba17-4ed75b8278f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:00.060971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808ced-1fb3-448b-ba17-4ed75b8278f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:00.061589 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a808ced-1fb3-448b-ba17-4ed75b8278f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:00.063476 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a808ced-1fb3-448b-ba17-4ed75b8278f5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:00.089879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1434/2875] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:19:59 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:20:00.093886 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f567b72-ece3-4ce2-8033-e091e6a57804 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:00.104515 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f567b72-ece3-4ce2-8033-e091e6a57804 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:00.161884 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cfd9e-518e-4161-ac45-0e1f1e7ff849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:00.162502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cfd9e-518e-4161-ac45-0e1f1e7ff849 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:00.162790 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cfd9e-518e-4161-ac45-0e1f1e7ff849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:00.163185 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cfd9e-518e-4161-ac45-0e1f1e7ff849 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:00.163840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cfd9e-518e-4161-ac45-0e1f1e7ff849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:00.165812 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cfd9e-518e-4161-ac45-0e1f1e7ff849 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:00.187069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1442/2876] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:20:00 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:20:00.191219 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a808ced-1fb3-448b-ba17-4ed75b8278f5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:00.202332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a808ced-1fb3-448b-ba17-4ed75b8278f5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:00.206971 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26bb1e-e000-409c-8349-474b2277a534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:00.207570 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26bb1e-e000-409c-8349-474b2277a534 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:00.207853 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26bb1e-e000-409c-8349-474b2277a534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:00.208128 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26bb1e-e000-409c-8349-474b2277a534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:00.208796 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26bb1e-e000-409c-8349-474b2277a534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:00.210381 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26bb1e-e000-409c-8349-474b2277a534 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:00.221387 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1435/2877] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:20:00.225818 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cfd9e-518e-4161-ac45-0e1f1e7ff849 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:00.235979 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cfd9e-518e-4161-ac45-0e1f1e7ff849 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:00.240669 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fda135-f12e-4c5b-b8f8-f215a4fd2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:00.241315 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fda135-f12e-4c5b-b8f8-f215a4fd2dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:00.241596 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fda135-f12e-4c5b-b8f8-f215a4fd2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:00.241870 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fda135-f12e-4c5b-b8f8-f215a4fd2dc0 admin admin] PATH_INFO: `/v3/projects/b90d0346b0484b3ea7d21b3de59cd80c/users/7cd0898f6ac9430090f78b31563ff14c/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:00.256506 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fda135-f12e-4c5b-b8f8-f215a4fd2dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90d0346b0484b3ea7d21b3de59cd80c, user_id=7cd0898f6ac9430090f78b31563ff14c, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:00.259370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fda135-f12e-4c5b-b8f8-f215a4fd2dc0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:00.272924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1443/2878] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:20:00 2022] PUT /identity/v3/projects/b90d0346b0484b3ea7d21b3de59cd80c/users/7cd0898f6ac9430090f78b31563ff14c/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:00.276945 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26bb1e-e000-409c-8349-474b2277a534 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:00.283899 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:00.288061 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26bb1e-e000-409c-8349-474b2277a534 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:00.346201 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc9296-37a4-48d7-9c63-75e59faabef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:00.346720 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9296-37a4-48d7-9c63-75e59faabef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:00.347000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9296-37a4-48d7-9c63-75e59faabef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:00.347273 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9296-37a4-48d7-9c63-75e59faabef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:00.347911 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc9296-37a4-48d7-9c63-75e59faabef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:00.349522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc9296-37a4-48d7-9c63-75e59faabef0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:00.360227 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1436/2879] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:20:00.365076 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fda135-f12e-4c5b-b8f8-f215a4fd2dc0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:00.376641 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fda135-f12e-4c5b-b8f8-f215a4fd2dc0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:00.383757 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba992d-a2db-4d1a-9e15-302c5ec6c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:00.385120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba992d-a2db-4d1a-9e15-302c5ec6c1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:00.385644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba992d-a2db-4d1a-9e15-302c5ec6c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:00.386172 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba992d-a2db-4d1a-9e15-302c5ec6c1f3 admin admin] PATH_INFO: `/v3/projects/b90d0346b0484b3ea7d21b3de59cd80c/users/7cd0898f6ac9430090f78b31563ff14c/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:00.389450 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba992d-a2db-4d1a-9e15-302c5ec6c1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90d0346b0484b3ea7d21b3de59cd80c, user_id=7cd0898f6ac9430090f78b31563ff14c, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:00.394898 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba992d-a2db-4d1a-9e15-302c5ec6c1f3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:00.407089 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1444/2880] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:20:00 2022] PUT /identity/v3/projects/b90d0346b0484b3ea7d21b3de59cd80c/users/7cd0898f6ac9430090f78b31563ff14c/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:00.418321 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6565a7-6d1a-4cf0-9cb2-37cec923765b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:00.419164 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6565a7-6d1a-4cf0-9cb2-37cec923765b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:00.419630 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6565a7-6d1a-4cf0-9cb2-37cec923765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:00.448586 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dd6565a7-6d1a-4cf0-9cb2-37cec923765b None None] MFA Rules not processed for user `7cd0898f6ac9430090f78b31563ff14c`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:00.450092 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dd6565a7-6d1a-4cf0-9cb2-37cec923765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:00.517802 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1437/2881] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:00.530099 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba992d-a2db-4d1a-9e15-302c5ec6c1f3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:00.531921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d6ba992d-a2db-4d1a-9e15-302c5ec6c1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:00.554645 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:00.592339 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba992d-a2db-4d1a-9e15-302c5ec6c1f3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:00.595984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaf2fe-f706-4d58-b2df-3192633ed9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:00.596674 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaf2fe-f706-4d58-b2df-3192633ed9ad service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:00.596907 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaf2fe-f706-4d58-b2df-3192633ed9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:00.597183 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaf2fe-f706-4d58-b2df-3192633ed9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:00.606713 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eaf2fe-f706-4d58-b2df-3192633ed9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:00.608134 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eaf2fe-f706-4d58-b2df-3192633ed9ad service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:00.617605 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1445/2882] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:20:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:20:00.658384 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6565a7-6d1a-4cf0-9cb2-37cec923765b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:00.659818 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dd6565a7-6d1a-4cf0-9cb2-37cec923765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:00.672697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6565a7-6d1a-4cf0-9cb2-37cec923765b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:00.676269 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d3ca6-8f3b-4d2a-b4e9-52a0e0c9e24f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:00.676898 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d3ca6-8f3b-4d2a-b4e9-52a0e0c9e24f service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:00.677176 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d3ca6-8f3b-4d2a-b4e9-52a0e0c9e24f service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:00.677446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d3ca6-8f3b-4d2a-b4e9-52a0e0c9e24f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:00.732780 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d3ca6-8f3b-4d2a-b4e9-52a0e0c9e24f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:00.734192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d3ca6-8f3b-4d2a-b4e9-52a0e0c9e24f service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:00.742827 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1438/2883] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:20:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:20:03.654805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaf2fe-f706-4d58-b2df-3192633ed9ad service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:03.723921 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaf2fe-f706-4d58-b2df-3192633ed9ad service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:03.728644 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:03.729283 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:03.729572 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:03.729850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] PATH_INFO: `/v3/users/97959908e7b94c34869ce18af7795347` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:03.730993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97959908e7b94c34869ce18af7795347)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:03.733343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:03.782023 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97959908e7b94c34869ce18af7795347'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:03.782689 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97959908e7b94c34869ce18af7795347'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:03.790758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97959908e7b94c34869ce18af7795347'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:03.799932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97959908e7b94c34869ce18af7795347'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:03.813186 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97959908e7b94c34869ce18af7795347'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:03.819499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1446/2884] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:20:03 2022] DELETE /identity/v3/users/97959908e7b94c34869ce18af7795347 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:03.824231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ef88-6186-4ffb-9814-ff3e75bb71df None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:03.825021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ef88-6186-4ffb-9814-ff3e75bb71df None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:03.825136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ef88-6186-4ffb-9814-ff3e75bb71df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:03.846000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1cf5ef88-6186-4ffb-9814-ff3e75bb71df None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:03.846296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1cf5ef88-6186-4ffb-9814-ff3e75bb71df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:03.866050 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:03.910323 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1439/2885] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:03.921022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:03.922447 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:03.970820 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:03.986680 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452df9c-a2ef-45d5-92af-d04e7749ae0a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:03.990798 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afff39-b7c4-438a-8725-9930099c350d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:03.991550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afff39-b7c4-438a-8725-9930099c350d service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:03.991816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afff39-b7c4-438a-8725-9930099c350d service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:03.992220 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afff39-b7c4-438a-8725-9930099c350d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:04.002866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afff39-b7c4-438a-8725-9930099c350d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:04.004296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afff39-b7c4-438a-8725-9930099c350d service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:04.013931 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1447/2886] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:20:04.296420 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ef88-6186-4ffb-9814-ff3e75bb71df None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:04.298085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1cf5ef88-6186-4ffb-9814-ff3e75bb71df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:04.311816 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ef88-6186-4ffb-9814-ff3e75bb71df None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:04.316669 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:04.317408 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:04.317760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:04.318110 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] PATH_INFO: `/v3/projects/3fcbc5e7b7994667b8801f6abad6b4f2` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:04.319368 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fcbc5e7b7994667b8801f6abad6b4f2)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:04.321555 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:04.371136 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fcbc5e7b7994667b8801f6abad6b4f2', 'request_id': 'req-a6350955-b069-40e8-ae8d-360b221d50e4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.381186 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fcbc5e7b7994667b8801f6abad6b4f2', 'request_id': 'req-a6350955-b069-40e8-ae8d-360b221d50e4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.389843 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fcbc5e7b7994667b8801f6abad6b4f2', 'request_id': 'req-a6350955-b069-40e8-ae8d-360b221d50e4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.401134 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] The token cache is being invalidate because project 3fcbc5e7b7994667b8801f6abad6b4f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:20:04.401429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.402070 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.403559 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1440/2887] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:20:04 2022] DELETE /identity/v3/projects/3fcbc5e7b7994667b8801f6abad6b4f2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:04.407599 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afff39-b7c4-438a-8725-9930099c350d service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:04.417316 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afff39-b7c4-438a-8725-9930099c350d service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:04.476615 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:04.477264 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:04.477553 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:04.477837 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] PATH_INFO: `/v3/users/336186686c1249b5bb4880355f946ca5` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:04.479001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=336186686c1249b5bb4880355f946ca5)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:04.480985 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:04.527473 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336186686c1249b5bb4880355f946ca5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.528133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336186686c1249b5bb4880355f946ca5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.535639 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336186686c1249b5bb4880355f946ca5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.542763 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336186686c1249b5bb4880355f946ca5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.554498 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336186686c1249b5bb4880355f946ca5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.560867 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1448/2888] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:20:04 2022] DELETE /identity/v3/users/336186686c1249b5bb4880355f946ca5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:04.832847 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:04.834296 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:04.847446 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6350955-b069-40e8-ae8d-360b221d50e4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:04.910879 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:04.911429 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:04.911712 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:04.911987 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] PATH_INFO: `/v3/projects/5c8cf168fc9846c3b3e59df500b5994d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:04.913153 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c8cf168fc9846c3b3e59df500b5994d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:04.915055 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:04.960765 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c8cf168fc9846c3b3e59df500b5994d', 'request_id': 'req-afc623d8-25bd-49a0-bfff-7d8aebaca05b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.961916 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:04.967480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c8cf168fc9846c3b3e59df500b5994d', 'request_id': 'req-afc623d8-25bd-49a0-bfff-7d8aebaca05b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.974434 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c8cf168fc9846c3b3e59df500b5994d', 'request_id': 'req-afc623d8-25bd-49a0-bfff-7d8aebaca05b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.987063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] The token cache is being invalidate because project 5c8cf168fc9846c3b3e59df500b5994d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:20:04.987356 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.987993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:04.989484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1441/2889] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:20:04 2022] DELETE /identity/v3/projects/5c8cf168fc9846c3b3e59df500b5994d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:04.993476 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:04.995299 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:05.008977 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0059f3-6033-4d46-85f5-55cfc6fb72f9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:05.066292 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:05.066924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:05.067206 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:05.067508 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] PATH_INFO: `/v3/users/7cd0898f6ac9430090f78b31563ff14c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:05.068666 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd0898f6ac9430090f78b31563ff14c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:05.070587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:05.075296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:05.119248 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd0898f6ac9430090f78b31563ff14c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:05.119912 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd0898f6ac9430090f78b31563ff14c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:05.127743 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd0898f6ac9430090f78b31563ff14c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:05.135624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd0898f6ac9430090f78b31563ff14c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:05.148084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8ac71278-60eb-4a16-a23b-9994f966c85f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd0898f6ac9430090f78b31563ff14c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:05.154858 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1449/2890] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:20:04 2022] DELETE /identity/v3/users/7cd0898f6ac9430090f78b31563ff14c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:05.419203 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:05.421359 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:05.434085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc623d8-25bd-49a0-bfff-7d8aebaca05b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:05.491430 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:05.492056 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:05.492349 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:05.492635 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] PATH_INFO: `/v3/projects/b90d0346b0484b3ea7d21b3de59cd80c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:05.493735 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90d0346b0484b3ea7d21b3de59cd80c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:05.495626 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:05.540238 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90d0346b0484b3ea7d21b3de59cd80c', 'request_id': 'req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:05.546235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90d0346b0484b3ea7d21b3de59cd80c', 'request_id': 'req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:05.553882 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90d0346b0484b3ea7d21b3de59cd80c', 'request_id': 'req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:05.565390 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] The token cache is being invalidate because project b90d0346b0484b3ea7d21b3de59cd80c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:20:05.565679 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:05.566304 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8c3df6f-4cb0-4bc9-9613-e9fc607a5c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:05.567769 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1442/2891] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:20:05 2022] DELETE /identity/v3/projects/b90d0346b0484b3ea7d21b3de59cd80c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:05.573663 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aaa78-3a61-4362-9f5e-38feff322a3b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:05.573952 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aaa78-3a61-4362-9f5e-38feff322a3b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:05.574231 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aaa78-3a61-4362-9f5e-38feff322a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:05.594157 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7f8aaa78-3a61-4362-9f5e-38feff322a3b None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:05.595356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7f8aaa78-3a61-4362-9f5e-38feff322a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:05.653452 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1450/2892] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:05.661636 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414d4e1-187f-4418-b9eb-fbb0a93e83f0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:05.661957 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414d4e1-187f-4418-b9eb-fbb0a93e83f0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:05.662235 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414d4e1-187f-4418-b9eb-fbb0a93e83f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:05.682342 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b414d4e1-187f-4418-b9eb-fbb0a93e83f0 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:05.683469 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b414d4e1-187f-4418-b9eb-fbb0a93e83f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:05.691997 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1443/2893] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:05.696152 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aaa78-3a61-4362-9f5e-38feff322a3b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:05.706224 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aaa78-3a61-4362-9f5e-38feff322a3b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:05.710776 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96d9f2-ed73-4490-9904-c7ae55281cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:05.711373 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96d9f2-ed73-4490-9904-c7ae55281cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:05.711652 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96d9f2-ed73-4490-9904-c7ae55281cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:05.711926 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96d9f2-ed73-4490-9904-c7ae55281cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:05.712633 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96d9f2-ed73-4490-9904-c7ae55281cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:20:05.712940 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96d9f2-ed73-4490-9904-c7ae55281cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:05.714516 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96d9f2-ed73-4490-9904-c7ae55281cc8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:05.726002 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1451/2894] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:20:05.730249 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414d4e1-187f-4418-b9eb-fbb0a93e83f0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:05.739928 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414d4e1-187f-4418-b9eb-fbb0a93e83f0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:05.744576 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268308c-0ce1-44c7-a6c1-09879c6b7091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:05.745174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268308c-0ce1-44c7-a6c1-09879c6b7091 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:05.745480 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268308c-0ce1-44c7-a6c1-09879c6b7091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:05.745753 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268308c-0ce1-44c7-a6c1-09879c6b7091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:05.746433 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268308c-0ce1-44c7-a6c1-09879c6b7091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:05.749014 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268308c-0ce1-44c7-a6c1-09879c6b7091 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:05.775625 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1444/2895] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:20:05 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:20:05.780276 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96d9f2-ed73-4490-9904-c7ae55281cc8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:05.790247 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96d9f2-ed73-4490-9904-c7ae55281cc8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:05.848112 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6682954-ed36-493f-b3a1-fb7a6227ce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:05.848758 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6682954-ed36-493f-b3a1-fb7a6227ce72 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:05.849045 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6682954-ed36-493f-b3a1-fb7a6227ce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:05.849323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6682954-ed36-493f-b3a1-fb7a6227ce72 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:05.849961 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6682954-ed36-493f-b3a1-fb7a6227ce72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:05.851883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6682954-ed36-493f-b3a1-fb7a6227ce72 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:05.869323 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:05.877017 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1452/2896] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:20:05 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:20:05.880165 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268308c-0ce1-44c7-a6c1-09879c6b7091 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:05.891672 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268308c-0ce1-44c7-a6c1-09879c6b7091 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:05.896415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a698e0-2a46-4109-a40d-f552a730b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:05.897017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a698e0-2a46-4109-a40d-f552a730b8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:05.897297 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a698e0-2a46-4109-a40d-f552a730b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:05.897571 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a698e0-2a46-4109-a40d-f552a730b8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:05.898207 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a698e0-2a46-4109-a40d-f552a730b8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:05.899821 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a698e0-2a46-4109-a40d-f552a730b8a0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:05.910568 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1445/2897] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:20:05.914690 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6682954-ed36-493f-b3a1-fb7a6227ce72 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:05.925487 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6682954-ed36-493f-b3a1-fb7a6227ce72 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:05.930595 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47920c87-913a-42d0-9bfd-60f532d72c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:05.931212 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920c87-913a-42d0-9bfd-60f532d72c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:05.931524 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920c87-913a-42d0-9bfd-60f532d72c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:05.931802 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920c87-913a-42d0-9bfd-60f532d72c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:05.932539 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47920c87-913a-42d0-9bfd-60f532d72c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:05.934123 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47920c87-913a-42d0-9bfd-60f532d72c8e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:05.946207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1453/2898] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:20:05.951329 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a698e0-2a46-4109-a40d-f552a730b8a0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:05.961426 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a698e0-2a46-4109-a40d-f552a730b8a0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:05.966116 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bbb2c-6f45-47d6-ac42-ddf10ba68f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:05.966803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bbb2c-6f45-47d6-ac42-ddf10ba68f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:05.967085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bbb2c-6f45-47d6-ac42-ddf10ba68f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:05.967363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bbb2c-6f45-47d6-ac42-ddf10ba68f5d admin admin] PATH_INFO: `/v3/projects/8597fecbbc964dcab4c0d07426c7ccb7/users/547830f99ad64d8981ecaf5df8de7d71/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:05.983189 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bbb2c-6f45-47d6-ac42-ddf10ba68f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8597fecbbc964dcab4c0d07426c7ccb7, user_id=547830f99ad64d8981ecaf5df8de7d71, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:05.985947 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bbb2c-6f45-47d6-ac42-ddf10ba68f5d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:05.999905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1446/2899] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:20:05 2022] PUT /identity/v3/projects/8597fecbbc964dcab4c0d07426c7ccb7/users/547830f99ad64d8981ecaf5df8de7d71/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:06.011369 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d16be-cb2b-4dfc-8666-f00789f6b3c4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:06.011915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d16be-cb2b-4dfc-8666-f00789f6b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:06.011915 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d16be-cb2b-4dfc-8666-f00789f6b3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:06.041360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-328d16be-cb2b-4dfc-8666-f00789f6b3c4 None None] MFA Rules not processed for user `547830f99ad64d8981ecaf5df8de7d71`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:06.045883 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-328d16be-cb2b-4dfc-8666-f00789f6b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:06.108173 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1454/2900] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:06.112779 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bbb2c-6f45-47d6-ac42-ddf10ba68f5d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:06.118314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:06.177991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bbb2c-6f45-47d6-ac42-ddf10ba68f5d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:06.183502 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c23032-4e3a-42a3-826f-29817c16f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:06.184059 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c23032-4e3a-42a3-826f-29817c16f108 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:06.184366 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c23032-4e3a-42a3-826f-29817c16f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:06.184646 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c23032-4e3a-42a3-826f-29817c16f108 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:06.185442 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c23032-4e3a-42a3-826f-29817c16f108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:06.187479 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c23032-4e3a-42a3-826f-29817c16f108 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:06.220095 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1447/2901] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:20:06 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:20:06.224159 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d16be-cb2b-4dfc-8666-f00789f6b3c4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:06.236852 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d16be-cb2b-4dfc-8666-f00789f6b3c4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:06.292768 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9027b2-a973-48dd-b9fe-824ae015aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:06.293370 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9027b2-a973-48dd-b9fe-824ae015aef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:06.293651 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9027b2-a973-48dd-b9fe-824ae015aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:06.293924 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9027b2-a973-48dd-b9fe-824ae015aef1 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:06.294587 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9027b2-a973-48dd-b9fe-824ae015aef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:06.296660 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9027b2-a973-48dd-b9fe-824ae015aef1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:06.319034 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1455/2902] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:20:06 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:20:06.321703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c23032-4e3a-42a3-826f-29817c16f108 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:06.332738 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c23032-4e3a-42a3-826f-29817c16f108 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:06.337455 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5a457-dedf-4c67-9023-2200d274b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:06.338052 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5a457-dedf-4c67-9023-2200d274b586 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:06.338340 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5a457-dedf-4c67-9023-2200d274b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:06.338616 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5a457-dedf-4c67-9023-2200d274b586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:06.339259 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5a457-dedf-4c67-9023-2200d274b586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:06.340908 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5a457-dedf-4c67-9023-2200d274b586 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:06.351848 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1448/2903] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:20:06.355793 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9027b2-a973-48dd-b9fe-824ae015aef1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:06.366356 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9027b2-a973-48dd-b9fe-824ae015aef1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:06.371046 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00c1f8-1b5f-4ca4-b41e-37b9d8bbc8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:06.371693 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00c1f8-1b5f-4ca4-b41e-37b9d8bbc8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:06.371977 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00c1f8-1b5f-4ca4-b41e-37b9d8bbc8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:06.372254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00c1f8-1b5f-4ca4-b41e-37b9d8bbc8e8 admin admin] PATH_INFO: `/v3/projects/072ecec900a544d29219784a56064d8f/users/300ef89cfe1241bf889e7ada0f3565f2/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:06.386984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00c1f8-1b5f-4ca4-b41e-37b9d8bbc8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072ecec900a544d29219784a56064d8f, user_id=300ef89cfe1241bf889e7ada0f3565f2, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:06.390624 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00c1f8-1b5f-4ca4-b41e-37b9d8bbc8e8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:06.405257 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1456/2904] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:20:06 2022] PUT /identity/v3/projects/072ecec900a544d29219784a56064d8f/users/300ef89cfe1241bf889e7ada0f3565f2/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:06.409467 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5a457-dedf-4c67-9023-2200d274b586 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:06.419330 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5a457-dedf-4c67-9023-2200d274b586 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:06.474955 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1671e09-0c47-4be2-b689-e6b88733f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:06.475484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1671e09-0c47-4be2-b689-e6b88733f0cb admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:06.475760 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1671e09-0c47-4be2-b689-e6b88733f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:06.476029 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1671e09-0c47-4be2-b689-e6b88733f0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:06.476697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1671e09-0c47-4be2-b689-e6b88733f0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:06.478265 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1671e09-0c47-4be2-b689-e6b88733f0cb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:06.487873 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1449/2905] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:20:06.492082 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00c1f8-1b5f-4ca4-b41e-37b9d8bbc8e8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:06.502655 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00c1f8-1b5f-4ca4-b41e-37b9d8bbc8e8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:06.507268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78c35e-ae91-4425-9a24-1c058d3a792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:06.508026 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c35e-ae91-4425-9a24-1c058d3a792c admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:06.508313 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c35e-ae91-4425-9a24-1c058d3a792c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:06.508619 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c35e-ae91-4425-9a24-1c058d3a792c admin admin] PATH_INFO: `/v3/projects/072ecec900a544d29219784a56064d8f/users/300ef89cfe1241bf889e7ada0f3565f2/roles/5ebfd449cc6d4760b8d292f3877f4d64` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:06.510517 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78c35e-ae91-4425-9a24-1c058d3a792c admin admin] RBAC: Authorizing `identity:create_grant(project_id=072ecec900a544d29219784a56064d8f, user_id=300ef89cfe1241bf889e7ada0f3565f2, role_id=5ebfd449cc6d4760b8d292f3877f4d64)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:06.513707 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78c35e-ae91-4425-9a24-1c058d3a792c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:06.523816 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1457/2906] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:20:06 2022] PUT /identity/v3/projects/072ecec900a544d29219784a56064d8f/users/300ef89cfe1241bf889e7ada0f3565f2/roles/5ebfd449cc6d4760b8d292f3877f4d64 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:06.536107 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc5f39-7f4a-40c7-b879-dcb0dbe82d0d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:06.536427 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc5f39-7f4a-40c7-b879-dcb0dbe82d0d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:06.536703 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc5f39-7f4a-40c7-b879-dcb0dbe82d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:06.564088 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e6fc5f39-7f4a-40c7-b879-dcb0dbe82d0d None None] MFA Rules not processed for user `300ef89cfe1241bf889e7ada0f3565f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:06.565363 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e6fc5f39-7f4a-40c7-b879-dcb0dbe82d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:06.628837 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:06.632963 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1450/2907] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:06.644550 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78c35e-ae91-4425-9a24-1c058d3a792c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:06.646242 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8b78c35e-ae91-4425-9a24-1c058d3a792c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:06.679892 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:06.705403 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78c35e-ae91-4425-9a24-1c058d3a792c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:06.709244 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba01a1-e164-4631-a08b-451c88291d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:06.709890 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba01a1-e164-4631-a08b-451c88291d17 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:06.710176 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba01a1-e164-4631-a08b-451c88291d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:06.710458 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba01a1-e164-4631-a08b-451c88291d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:06.767336 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba01a1-e164-4631-a08b-451c88291d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:06.768741 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba01a1-e164-4631-a08b-451c88291d17 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:06.777541 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1458/2908] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:20:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:20:10.975172 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc5f39-7f4a-40c7-b879-dcb0dbe82d0d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:10.976585 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e6fc5f39-7f4a-40c7-b879-dcb0dbe82d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:10.988395 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc5f39-7f4a-40c7-b879-dcb0dbe82d0d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:10.991959 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129061c-8967-4808-aff4-62611441395a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:10.992593 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129061c-8967-4808-aff4-62611441395a service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:10.992875 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129061c-8967-4808-aff4-62611441395a service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:10.993148 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129061c-8967-4808-aff4-62611441395a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:11.002416 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129061c-8967-4808-aff4-62611441395a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:11.003870 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129061c-8967-4808-aff4-62611441395a service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:11.014053 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1451/2909] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:20:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:20:15.953893 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba01a1-e164-4631-a08b-451c88291d17 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:16.019963 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba01a1-e164-4631-a08b-451c88291d17 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:16.024888 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:16.025534 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:16.025850 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:16.026131 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] PATH_INFO: `/v3/users/547830f99ad64d8981ecaf5df8de7d71` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:16.027282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547830f99ad64d8981ecaf5df8de7d71)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:16.029367 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:16.079545 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547830f99ad64d8981ecaf5df8de7d71'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.080239 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547830f99ad64d8981ecaf5df8de7d71'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.090274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547830f99ad64d8981ecaf5df8de7d71'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.099133 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547830f99ad64d8981ecaf5df8de7d71'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.112866 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547830f99ad64d8981ecaf5df8de7d71'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.119188 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1459/2910] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:20:15 2022] DELETE /identity/v3/users/547830f99ad64d8981ecaf5df8de7d71 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:16.124157 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ebb7d-0955-429c-a155-f29afeb7b744 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:16.124688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ebb7d-0955-429c-a155-f29afeb7b744 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:16.124813 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ebb7d-0955-429c-a155-f29afeb7b744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:16.153857 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0b0ebb7d-0955-429c-a155-f29afeb7b744 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:16.155931 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0b0ebb7d-0955-429c-a155-f29afeb7b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:16.217169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1452/2911] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:20:16.229001 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:16.230687 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:16.238573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:16.294797 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06941d20-1592-46e4-b3bc-da9eaad017b2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:16.298282 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878dde2-2daa-4e4a-94f2-46119d2163f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:16.298889 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878dde2-2daa-4e4a-94f2-46119d2163f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:16.299171 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878dde2-2daa-4e4a-94f2-46119d2163f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:16.299446 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878dde2-2daa-4e4a-94f2-46119d2163f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:16.309069 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878dde2-2daa-4e4a-94f2-46119d2163f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:16.310971 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878dde2-2daa-4e4a-94f2-46119d2163f8 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:16.321200 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1460/2912] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:20:16.607122 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ebb7d-0955-429c-a155-f29afeb7b744 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:16.610985 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0b0ebb7d-0955-429c-a155-f29afeb7b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:16.625554 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ebb7d-0955-429c-a155-f29afeb7b744 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:16.630676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:16.631404 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:16.631710 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:16.632061 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] PATH_INFO: `/v3/projects/8597fecbbc964dcab4c0d07426c7ccb7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:16.634924 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8597fecbbc964dcab4c0d07426c7ccb7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:16.637104 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:16.684788 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8597fecbbc964dcab4c0d07426c7ccb7', 'request_id': 'req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.690462 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8597fecbbc964dcab4c0d07426c7ccb7', 'request_id': 'req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.698149 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8597fecbbc964dcab4c0d07426c7ccb7', 'request_id': 'req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.711041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] The token cache is being invalidate because project 8597fecbbc964dcab4c0d07426c7ccb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:20:16.711332 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.711976 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.713475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1453/2913] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:20:16 2022] DELETE /identity/v3/projects/8597fecbbc964dcab4c0d07426c7ccb7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:16.718439 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878dde2-2daa-4e4a-94f2-46119d2163f8 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:16.728735 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878dde2-2daa-4e4a-94f2-46119d2163f8 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:16.790030 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:16.790670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:16.790951 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:16.791226 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] PATH_INFO: `/v3/users/300ef89cfe1241bf889e7ada0f3565f2` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:16.792440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=300ef89cfe1241bf889e7ada0f3565f2)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:16.794440 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:16.851828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300ef89cfe1241bf889e7ada0f3565f2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.852525 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300ef89cfe1241bf889e7ada0f3565f2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.860499 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300ef89cfe1241bf889e7ada0f3565f2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.867835 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300ef89cfe1241bf889e7ada0f3565f2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.880343 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b4fc9a7a-d8b5-42ad-814d-99729ea2cf13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300ef89cfe1241bf889e7ada0f3565f2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:16.886502 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1461/2914] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:20:16 2022] DELETE /identity/v3/users/300ef89cfe1241bf889e7ada0f3565f2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:17.180375 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:17.182025 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:17.204120 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93c32c-6f84-4aee-8277-8c7bcf1f4749 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:17.272470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:17.272470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:17.272470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:17.272470 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] PATH_INFO: `/v3/projects/072ecec900a544d29219784a56064d8f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:17.272998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] RBAC: Authorizing `identity:delete_project(project_id=072ecec900a544d29219784a56064d8f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:17.274803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:17.288101 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:17.331324 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072ecec900a544d29219784a56064d8f', 'request_id': 'req-b974331a-0e11-460b-a7d8-869b3d2b271f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:17.337484 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072ecec900a544d29219784a56064d8f', 'request_id': 'req-b974331a-0e11-460b-a7d8-869b3d2b271f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:17.351192 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072ecec900a544d29219784a56064d8f', 'request_id': 'req-b974331a-0e11-460b-a7d8-869b3d2b271f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:17.364076 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] The token cache is being invalidate because project 072ecec900a544d29219784a56064d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:20:17.364409 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:17.365087 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b974331a-0e11-460b-a7d8-869b3d2b271f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:17.366588 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1454/2915] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:20:17 2022] DELETE /identity/v3/projects/072ecec900a544d29219784a56064d8f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:17.372854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5aeee-5c91-46dc-bf96-c062054210ac None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:17.373964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5aeee-5c91-46dc-bf96-c062054210ac None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:17.373964 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5aeee-5c91-46dc-bf96-c062054210ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:17.394084 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-12b5aeee-5c91-46dc-bf96-c062054210ac None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:17.395322 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-12b5aeee-5c91-46dc-bf96-c062054210ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:17.425009 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:17.471874 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1462/2916] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:17.480665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4633c9-aaff-4578-800d-12d99135cafc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:17.480951 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4633c9-aaff-4578-800d-12d99135cafc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:17.481331 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4633c9-aaff-4578-800d-12d99135cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:17.505460 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ba4633c9-aaff-4578-800d-12d99135cafc None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:17.506687 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ba4633c9-aaff-4578-800d-12d99135cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:17.515365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1455/2917] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:17.519786 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5aeee-5c91-46dc-bf96-c062054210ac None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:17.529854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5aeee-5c91-46dc-bf96-c062054210ac None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:17.534432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90689d3f-4289-4622-82c0-ff71e4103d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:17.535051 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90689d3f-4289-4622-82c0-ff71e4103d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:17.535328 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90689d3f-4289-4622-82c0-ff71e4103d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:17.535606 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90689d3f-4289-4622-82c0-ff71e4103d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:17.536267 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90689d3f-4289-4622-82c0-ff71e4103d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:20:17.536606 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90689d3f-4289-4622-82c0-ff71e4103d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:17.540833 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90689d3f-4289-4622-82c0-ff71e4103d71 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:17.553274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1463/2918] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 01:20:17.558023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4633c9-aaff-4578-800d-12d99135cafc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:17.569211 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4633c9-aaff-4578-800d-12d99135cafc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:17.574561 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479df59-e2c6-4388-8499-d4452f6b866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:17.575181 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479df59-e2c6-4388-8499-d4452f6b866e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:17.575463 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479df59-e2c6-4388-8499-d4452f6b866e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:17.575771 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479df59-e2c6-4388-8499-d4452f6b866e admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:17.576748 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479df59-e2c6-4388-8499-d4452f6b866e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:17.578697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479df59-e2c6-4388-8499-d4452f6b866e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:17.620522 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1456/2919] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:20:17 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:20:17.626460 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90689d3f-4289-4622-82c0-ff71e4103d71 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:17.637528 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90689d3f-4289-4622-82c0-ff71e4103d71 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:17.708629 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4252aa-4adc-4c7f-b312-3d4535379c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:17.709281 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4252aa-4adc-4c7f-b312-3d4535379c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:17.709573 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4252aa-4adc-4c7f-b312-3d4535379c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:17.709851 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4252aa-4adc-4c7f-b312-3d4535379c03 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:17.710505 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4252aa-4adc-4c7f-b312-3d4535379c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:17.712480 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4252aa-4adc-4c7f-b312-3d4535379c03 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:17.736626 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1464/2920] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:20:17 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:20:17.741902 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479df59-e2c6-4388-8499-d4452f6b866e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:17.757386 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479df59-e2c6-4388-8499-d4452f6b866e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:17.762385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270844-b710-4fdb-bec6-0ded140a944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:17.763006 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270844-b710-4fdb-bec6-0ded140a944c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:17.763311 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270844-b710-4fdb-bec6-0ded140a944c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:17.763734 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270844-b710-4fdb-bec6-0ded140a944c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:17.764353 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1270844-b710-4fdb-bec6-0ded140a944c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:17.765975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1270844-b710-4fdb-bec6-0ded140a944c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:17.776605 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1457/2921] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:20:17.782265 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4252aa-4adc-4c7f-b312-3d4535379c03 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:17.793421 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4252aa-4adc-4c7f-b312-3d4535379c03 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:17.798927 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f08a58-4b36-4e45-aee9-56f8b7275851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:17.799543 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f08a58-4b36-4e45-aee9-56f8b7275851 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:17.799831 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f08a58-4b36-4e45-aee9-56f8b7275851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:17.800110 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f08a58-4b36-4e45-aee9-56f8b7275851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:17.800817 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f08a58-4b36-4e45-aee9-56f8b7275851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:17.802426 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f08a58-4b36-4e45-aee9-56f8b7275851 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:17.813597 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1465/2922] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:20:17.818691 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270844-b710-4fdb-bec6-0ded140a944c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:17.837102 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270844-b710-4fdb-bec6-0ded140a944c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:17.845620 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b04235-fd4c-48b9-8594-31a83422c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:17.846681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04235-fd4c-48b9-8594-31a83422c84d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:17.847125 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04235-fd4c-48b9-8594-31a83422c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:17.847591 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04235-fd4c-48b9-8594-31a83422c84d admin admin] PATH_INFO: `/v3/projects/d98452401cf14309bf616f27b555eae6/users/921080c02ed64a908a627464d58226aa/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:17.868158 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b04235-fd4c-48b9-8594-31a83422c84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98452401cf14309bf616f27b555eae6, user_id=921080c02ed64a908a627464d58226aa, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:17.870869 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b04235-fd4c-48b9-8594-31a83422c84d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:17.889681 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1458/2923] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:20:17 2022] PUT /identity/v3/projects/d98452401cf14309bf616f27b555eae6/users/921080c02ed64a908a627464d58226aa/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:17.903022 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90183bc-f2a4-49da-b7ca-3ca615e074cb None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:17.903300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90183bc-f2a4-49da-b7ca-3ca615e074cb None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:17.903578 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90183bc-f2a4-49da-b7ca-3ca615e074cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:17.934840 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f90183bc-f2a4-49da-b7ca-3ca615e074cb None None] MFA Rules not processed for user `921080c02ed64a908a627464d58226aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:17.936254 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f90183bc-f2a4-49da-b7ca-3ca615e074cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:18.005787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1466/2924] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:18.017614 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b04235-fd4c-48b9-8594-31a83422c84d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:18.019341 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c3b04235-fd4c-48b9-8594-31a83422c84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:18.084000 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b04235-fd4c-48b9-8594-31a83422c84d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:18.087991 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8803c-defd-47d9-acf5-8b7f225018cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:18.088639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8803c-defd-47d9-acf5-8b7f225018cb service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:18.088927 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8803c-defd-47d9-acf5-8b7f225018cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:18.089205 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8803c-defd-47d9-acf5-8b7f225018cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:18.099223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8803c-defd-47d9-acf5-8b7f225018cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:18.100705 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8803c-defd-47d9-acf5-8b7f225018cb service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:18.110665 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1459/2925] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:20:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:20:21.366747 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90183bc-f2a4-49da-b7ca-3ca615e074cb None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:21.406772 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:21.481058 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90183bc-f2a4-49da-b7ca-3ca615e074cb None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:21.489274 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:21.490296 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:21.490728 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:21.491182 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] PATH_INFO: `/v3/users/921080c02ed64a908a627464d58226aa` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:21.493096 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] RBAC: Authorizing `identity:delete_user(user_id=921080c02ed64a908a627464d58226aa)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:21.496493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:21.568530 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '921080c02ed64a908a627464d58226aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:21.569207 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '921080c02ed64a908a627464d58226aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:21.578214 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '921080c02ed64a908a627464d58226aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:21.586843 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '921080c02ed64a908a627464d58226aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:21.601443 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '921080c02ed64a908a627464d58226aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:21.608984 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1467/2926] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:20:21 2022] DELETE /identity/v3/users/921080c02ed64a908a627464d58226aa => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 01:20:21.616697 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdcbc6-c1f4-4f30-b106-d4b7e445179e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:21.617320 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdcbc6-c1f4-4f30-b106-d4b7e445179e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:21.617800 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdcbc6-c1f4-4f30-b106-d4b7e445179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:21.640674 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1ecdcbc6-c1f4-4f30-b106-d4b7e445179e None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:21.641915 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1ecdcbc6-c1f4-4f30-b106-d4b7e445179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:21.691131 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:21.737365 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1460/2927] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:21.747258 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:21.749472 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:21.828571 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71397f7c-431c-42f3-8a56-aba8a8e868db admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:21.832770 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e229d1-ffe1-41ad-9735-61ba328f9e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:21.833384 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e229d1-ffe1-41ad-9735-61ba328f9e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:21.833662 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e229d1-ffe1-41ad-9735-61ba328f9e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:21.833941 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e229d1-ffe1-41ad-9735-61ba328f9e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:21.844360 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e229d1-ffe1-41ad-9735-61ba328f9e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:21.845996 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e229d1-ffe1-41ad-9735-61ba328f9e5d service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:21.856774 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1468/2928] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:20:22.207139 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdcbc6-c1f4-4f30-b106-d4b7e445179e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:22.210010 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1ecdcbc6-c1f4-4f30-b106-d4b7e445179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:22.228312 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdcbc6-c1f4-4f30-b106-d4b7e445179e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:22.236993 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:22.238174 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:22.238690 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:22.239223 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] PATH_INFO: `/v3/projects/d98452401cf14309bf616f27b555eae6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:22.241394 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98452401cf14309bf616f27b555eae6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:22.245322 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:22.321751 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98452401cf14309bf616f27b555eae6', 'request_id': 'req-293f2bae-9617-4411-b8dc-abaab6edb2e0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:22.330822 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98452401cf14309bf616f27b555eae6', 'request_id': 'req-293f2bae-9617-4411-b8dc-abaab6edb2e0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:22.338958 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98452401cf14309bf616f27b555eae6', 'request_id': 'req-293f2bae-9617-4411-b8dc-abaab6edb2e0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:22.351832 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] The token cache is being invalidate because project d98452401cf14309bf616f27b555eae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:20:22.352415 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:22.353085 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-293f2bae-9617-4411-b8dc-abaab6edb2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:22.354742 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1461/2929] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:20:22 2022] DELETE /identity/v3/projects/d98452401cf14309bf616f27b555eae6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:22.362899 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571685a7-994d-439f-a9b0-6e4ac4fbbdf6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:22.363381 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571685a7-994d-439f-a9b0-6e4ac4fbbdf6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:22.363876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571685a7-994d-439f-a9b0-6e4ac4fbbdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:22.389514 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-571685a7-994d-439f-a9b0-6e4ac4fbbdf6 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:22.390936 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-571685a7-994d-439f-a9b0-6e4ac4fbbdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:22.439184 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:22.469018 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1469/2930] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:22.477349 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5da18-e2b8-473a-9ba6-9528a0547321 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:22.477698 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5da18-e2b8-473a-9ba6-9528a0547321 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:22.478041 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5da18-e2b8-473a-9ba6-9528a0547321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:22.500754 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f1b5da18-e2b8-473a-9ba6-9528a0547321 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:22.502012 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f1b5da18-e2b8-473a-9ba6-9528a0547321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:22.510676 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1462/2931] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 01:20:22.515876 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571685a7-994d-439f-a9b0-6e4ac4fbbdf6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:22.528454 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571685a7-994d-439f-a9b0-6e4ac4fbbdf6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:22.535849 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bae77e-678e-46f7-ba57-a860612cd6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:22.536905 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae77e-678e-46f7-ba57-a860612cd6be admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:22.537376 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae77e-678e-46f7-ba57-a860612cd6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:22.537842 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae77e-678e-46f7-ba57-a860612cd6be admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:22.539011 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bae77e-678e-46f7-ba57-a860612cd6be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 01:20:22.539559 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bae77e-678e-46f7-ba57-a860612cd6be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:22.542493 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bae77e-678e-46f7-ba57-a860612cd6be admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:22.563052 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1470/2932] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Aug 31 01:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 01:20:22.567688 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5da18-e2b8-473a-9ba6-9528a0547321 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:22.578623 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5da18-e2b8-473a-9ba6-9528a0547321 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:22.583807 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1009f-380b-491a-b1f9-4c5a49d0d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:22.584475 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1009f-380b-491a-b1f9-4c5a49d0d75a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:22.584757 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1009f-380b-491a-b1f9-4c5a49d0d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:22.585034 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1009f-380b-491a-b1f9-4c5a49d0d75a admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:22.585693 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1009f-380b-491a-b1f9-4c5a49d0d75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:22.587639 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1009f-380b-491a-b1f9-4c5a49d0d75a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:22.622144 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1463/2933] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Aug 31 01:20:22 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 01:20:22.628971 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bae77e-678e-46f7-ba57-a860612cd6be admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:22.645111 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bae77e-678e-46f7-ba57-a860612cd6be admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:22.743993 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972dbf-f821-43f6-b11d-b9b67f67ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:22.744576 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972dbf-f821-43f6-b11d-b9b67f67ef26 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:22.744879 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972dbf-f821-43f6-b11d-b9b67f67ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:22.745164 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972dbf-f821-43f6-b11d-b9b67f67ef26 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:22.745824 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1972dbf-f821-43f6-b11d-b9b67f67ef26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:22.749120 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1972dbf-f821-43f6-b11d-b9b67f67ef26 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:22.784875 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1471/2934] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Aug 31 01:20:22 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 01:20:22.790711 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1009f-380b-491a-b1f9-4c5a49d0d75a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:22.807840 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1009f-380b-491a-b1f9-4c5a49d0d75a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:22.817021 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b569edd-9144-4548-9190-3ddde7c144d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:22.818298 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b569edd-9144-4548-9190-3ddde7c144d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:22.818812 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b569edd-9144-4548-9190-3ddde7c144d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:22.819314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b569edd-9144-4548-9190-3ddde7c144d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:22.820563 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b569edd-9144-4548-9190-3ddde7c144d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:22.823700 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b569edd-9144-4548-9190-3ddde7c144d0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:22.844188 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1464/2935] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:20:22.848997 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972dbf-f821-43f6-b11d-b9b67f67ef26 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:22.863806 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972dbf-f821-43f6-b11d-b9b67f67ef26 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:22.873298 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68b9e0-4daf-45a1-ac14-069c38a5a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:22.875268 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b9e0-4daf-45a1-ac14-069c38a5a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:22.875805 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b9e0-4daf-45a1-ac14-069c38a5a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:22.876237 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b9e0-4daf-45a1-ac14-069c38a5a2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:22.877854 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68b9e0-4daf-45a1-ac14-069c38a5a2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:22.880730 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68b9e0-4daf-45a1-ac14-069c38a5a2eb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:22.893429 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1472/2936] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Aug 31 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 01:20:22.899497 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b569edd-9144-4548-9190-3ddde7c144d0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:22.912917 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b569edd-9144-4548-9190-3ddde7c144d0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:22.921483 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ff6b6-09d1-4efa-b1a1-336c9e52c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:22.922572 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ff6b6-09d1-4efa-b1a1-336c9e52c129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:22.923048 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ff6b6-09d1-4efa-b1a1-336c9e52c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:22.923516 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ff6b6-09d1-4efa-b1a1-336c9e52c129 admin admin] PATH_INFO: `/v3/projects/23e97f18bfe149d6931f88ba2f6cbdd3/users/de50af50f5d6484f9ad975eb6b34b543/roles/2db61e25a9cb41608fb5c1dd7983e1d9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:22.951803 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ff6b6-09d1-4efa-b1a1-336c9e52c129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e97f18bfe149d6931f88ba2f6cbdd3, user_id=de50af50f5d6484f9ad975eb6b34b543, role_id=2db61e25a9cb41608fb5c1dd7983e1d9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:22.957378 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ff6b6-09d1-4efa-b1a1-336c9e52c129 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:22.979762 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1465/2937] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Aug 31 01:20:22 2022] PUT /identity/v3/projects/23e97f18bfe149d6931f88ba2f6cbdd3/users/de50af50f5d6484f9ad975eb6b34b543/roles/2db61e25a9cb41608fb5c1dd7983e1d9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:22.999545 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b506a64-72bc-4219-ad1a-0c2c47cd1cc7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:22.999882 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b506a64-72bc-4219-ad1a-0c2c47cd1cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:23.000271 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b506a64-72bc-4219-ad1a-0c2c47cd1cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:23.033251 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8b506a64-72bc-4219-ad1a-0c2c47cd1cc7 None None] MFA Rules not processed for user `de50af50f5d6484f9ad975eb6b34b543`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:23.034514 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8b506a64-72bc-4219-ad1a-0c2c47cd1cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:23.146670 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1473/2938] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:23.161256 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ff6b6-09d1-4efa-b1a1-336c9e52c129 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:23.163023 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-161ff6b6-09d1-4efa-b1a1-336c9e52c129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:23.233905 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ff6b6-09d1-4efa-b1a1-336c9e52c129 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:23.238196 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eed792-de47-4b45-b5cd-206704636469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '376dd413b33c4f4987f6bba3b14f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:23.238901 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eed792-de47-4b45-b5cd-206704636469 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:23.239231 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eed792-de47-4b45-b5cd-206704636469 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:23.239557 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eed792-de47-4b45-b5cd-206704636469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:23.249514 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eed792-de47-4b45-b5cd-206704636469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:23.251017 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eed792-de47-4b45-b5cd-206704636469 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:23.264063 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1466/2939] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:20:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 01:20:33.141771 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:33.256385 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:33.975213 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b506a64-72bc-4219-ad1a-0c2c47cd1cc7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:34.037067 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b506a64-72bc-4219-ad1a-0c2c47cd1cc7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:34.041623 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:34.042263 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:34.042549 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:34.042828 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] PATH_INFO: `/v3/users/de50af50f5d6484f9ad975eb6b34b543` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:34.043950 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de50af50f5d6484f9ad975eb6b34b543)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:34.045938 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:34.093895 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de50af50f5d6484f9ad975eb6b34b543'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:34.094551 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de50af50f5d6484f9ad975eb6b34b543'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:34.103275 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de50af50f5d6484f9ad975eb6b34b543'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:34.110399 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de50af50f5d6484f9ad975eb6b34b543'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:34.124411 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de50af50f5d6484f9ad975eb6b34b543'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:34.130787 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1474/2940] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Aug 31 01:20:33 2022] DELETE /identity/v3/users/de50af50f5d6484f9ad975eb6b34b543 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:34.135019 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d3b90-6ba0-4cfa-a133-eb6a3c76e844 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:34.135314 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d3b90-6ba0-4cfa-a133-eb6a3c76e844 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:34.135597 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d3b90-6ba0-4cfa-a133-eb6a3c76e844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:34.156737 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a34d3b90-6ba0-4cfa-a133-eb6a3c76e844 None None] MFA Rules not processed for user `76669597ccb648f3a43d97e4bc8fbea8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 01:20:34.157960 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a34d3b90-6ba0-4cfa-a133-eb6a3c76e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:34.217432 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1467/2941] 10.222.0.83 () {58 vars in 958 bytes} [Wed Aug 31 01:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 01:20:34.226947 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:34.228387 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:34.286014 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae6968-a317-49ca-8fac-3a1126990073 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:34.289654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703be52-e1a4-49a3-994f-b373763d8aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c13711596647178ad3f93865eca187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:34.290257 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703be52-e1a4-49a3-994f-b373763d8aab service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:34.290538 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703be52-e1a4-49a3-994f-b373763d8aab service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:34.290811 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703be52-e1a4-49a3-994f-b373763d8aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:34.299635 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703be52-e1a4-49a3-994f-b373763d8aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:34.301095 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703be52-e1a4-49a3-994f-b373763d8aab service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:34.311300 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1475/2942] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:20:34.596660 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d3b90-6ba0-4cfa-a133-eb6a3c76e844 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:20:34.598301 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a34d3b90-6ba0-4cfa-a133-eb6a3c76e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:20:34.611024 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d3b90-6ba0-4cfa-a133-eb6a3c76e844 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:20:34.616008 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76669597ccb648f3a43d97e4bc8fbea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '945912bdd11549de9a3f98d9095b0494', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:20:34.616667 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:20:34.616949 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:20:34.617225 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] PATH_INFO: `/v3/projects/23e97f18bfe149d6931f88ba2f6cbdd3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:20:34.618352 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e97f18bfe149d6931f88ba2f6cbdd3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:20:34.620268 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:20:34.680169 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e97f18bfe149d6931f88ba2f6cbdd3', 'request_id': 'req-9b9d82d1-1c79-4e59-9a48-02a79c13376c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:34.685975 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e97f18bfe149d6931f88ba2f6cbdd3', 'request_id': 'req-9b9d82d1-1c79-4e59-9a48-02a79c13376c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:34.693628 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e97f18bfe149d6931f88ba2f6cbdd3', 'request_id': 'req-9b9d82d1-1c79-4e59-9a48-02a79c13376c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:34.705574 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] The token cache is being invalidate because project 23e97f18bfe149d6931f88ba2f6cbdd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 01:20:34.705866 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:34.706512 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9b9d82d1-1c79-4e59-9a48-02a79c13376c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 01:20:34.707998 dv-cinder-855288-2-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1468/2943] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Aug 31 01:20:34 2022] DELETE /identity/v3/projects/23e97f18bfe149d6931f88ba2f6cbdd3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 01:20:44.306314 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:44.702281 dv-cinder-855288-2-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:21:46.543235 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703be52-e1a4-49a3-994f-b373763d8aab service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 01:21:46.544676 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9703be52-e1a4-49a3-994f-b373763d8aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:21:46.615390 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703be52-e1a4-49a3-994f-b373763d8aab service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 01:21:46.675432 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f33a59-8196-4707-b1c6-5bfdc0530645 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eb93baf45174c10a6fcbe321ac65764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3624d0e59c4f84a9b132c17ebdd932', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 01:21:46.676020 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33a59-8196-4707-b1c6-5bfdc0530645 service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 01:21:46.676375 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33a59-8196-4707-b1c6-5bfdc0530645 service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 01:21:46.676654 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33a59-8196-4707-b1c6-5bfdc0530645 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 01:21:46.678371 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d8f33a59-8196-4707-b1c6-5bfdc0530645 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 01:21:46.689751 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f33a59-8196-4707-b1c6-5bfdc0530645 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 01:21:46.691317 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f33a59-8196-4707-b1c6-5bfdc0530645 service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 01:21:46.704932 dv-cinder-855288-2-smb devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1476/2944] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Aug 31 01:21:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 01:21:56.700582 dv-cinder-855288-2-smb devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=58 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}